-- Logs begin at Fri 2022-05-13 14:10:33 UTC, end at Fri 2022-05-13 15:20:38 UTC. -- May 13 14:39:10.998347 dv-cinder-830901-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 13 14:39:11.005960 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 14:39:11 2022] *** May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: nodename: dv-cinder-830901-6-iscsi May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: machine: x86_64 May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: clock source: unix May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: pcre jit disabled May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: detected number of CPU cores: 4 May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: current working directory: / May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: detected binary path: /usr/bin/uwsgi-core May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: your processes number limit is 47680 May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: your memory page size is 4096 bytes May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: detected max file descriptor number: 2048 May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: lock engine: pthread robust mutexes May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: thunder lock: enabled May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 13 14:39:11.011908 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 14:39:11.055207 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: Python main interpreter initialized at 0x5600ab1a29c0 May 13 14:39:11.055207 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: python threads support enabled May 13 14:39:11.055207 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: your server socket listen backlog is limited to 100 connections May 13 14:39:11.055207 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: your mercy for graceful operations on workers is 90 seconds May 13 14:39:11.055622 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: mapped 403077 bytes (393 KB) for 2 cores May 13 14:39:11.055622 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: *** Operational MODE: preforking *** May 13 14:39:11.055974 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: *** uWSGI is running in multiple interpreter mode *** May 13 14:39:11.055974 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: spawned uWSGI master process (pid: 80241) May 13 14:39:11.056159 dv-cinder-830901-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 13 14:39:11.058157 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: spawned uWSGI worker 1 (pid: 80254, cores: 1) May 13 14:39:11.058157 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: spawned uWSGI worker 2 (pid: 80255, cores: 1) May 13 14:39:11.058157 dv-cinder-830901-6-iscsi devstack@keystone.service[80241]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 14:39:16.749687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:39:16.749687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: from cryptography.utils import int_from_bytes May 13 14:39:16.750472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:39:16.750472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: from cryptography.utils import int_from_bytes May 13 14:39:16.753037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:39:16.753037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: from cryptography.utils import int_from_bytes May 13 14:39:16.753537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:39:16.753537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: from cryptography.utils import int_from_bytes May 13 14:39:16.799413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:39:16.799575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:39:16.799775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] command line args: [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:39:16.799979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:39:16.800073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:39:16.800135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:39:16.800192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ================================================================================ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:39:16.800255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] command line args: [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:39:16.800424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] admin_token = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.800503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:39:16.800653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config_dir = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.800737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ================================================================================ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:39:16.800802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.800940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] admin_token = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.801023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config_source = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.801159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] debug = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.801242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config_dir = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.801369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.801449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.803749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config_source = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.803831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.803831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] debug = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_config_append = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_dir = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.804967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_config_append = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_dir = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.805973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.806898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.807559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.807769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.99/identity {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.807947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.808188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] publish_errors = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.808188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.808188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.808705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.99/identity {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.808931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.809100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] publish_errors = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.809289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.809477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.809663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.809857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.809857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.810313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] standard_threads = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.810507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.810734 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.810961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.811128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.811322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] standard_threads = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.811510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.811510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_journal = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.811910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.812071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_json = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.812240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.812405 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_stderr = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.812535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.812704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_syslog = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.812843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_journal = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.813001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.813142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_json = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.813142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_stderr = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.813400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.813526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_syslog = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.813806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.813939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:39:16.814065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.814065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.814301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.814426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.814566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.814566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.814804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.814934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.815074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.815200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.815403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.815539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.815667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.815799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.815964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.816102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.816242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.816369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.816499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.816630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.816756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.816887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.817951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.818981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.819112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.819238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.819370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.819502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.819628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.819752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.819905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.820976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.821108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.821232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.821357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.821487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.821691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.821825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.821950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.822989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.823121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.823262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.823387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.823583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.823714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.823840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824425 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.824933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.825064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.825190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.825317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.825442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.825568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.825701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.825826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.827109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.827280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.827478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.827674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.827913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.828077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.828265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.828453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.828681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.828843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.829077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.829240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.829493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.829701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.829865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.830072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.830295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.830463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.830650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.830884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.831051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.831239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.831462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.831625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.831812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.832029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.832201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.832343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.832539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.832678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.832836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.832974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.833110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.833110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.833349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.833514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.833653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.833653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.833902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.834036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.834194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.834425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.834598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.834598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.834881 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.835012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.835145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.835280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.835413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.835539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.835666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.835792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.836033 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.836270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.836417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.836554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.836681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.836809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.836935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.837073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.837200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.837327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.837489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.837648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.837648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.837970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838479 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.838994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.839119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.839246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.839377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.839513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.839640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.839765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.839930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.840104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.840254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.840436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.840575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.840704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.840840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.840968 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.841095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.841234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.841371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.841510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.841638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.841765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.841903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.842936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.843072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.843199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.843326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.843460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.843588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.843725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.843861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.844029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.844158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.844285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.844417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.844579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.844727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.844925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.external = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.845086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.845217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.845344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.external = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.845344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.845592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.845592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.845882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.password = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.password = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.token = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.token = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.846941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.847068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.847202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.847339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.847477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.847605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.847732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.847859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.848012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.848152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.848299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.848505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.848672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.848804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.848932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.849067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.849196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.849325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.849466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.849909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.850955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.851083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.851210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.851337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.851475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.851604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.851740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.851933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.852204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.852379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.852513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.852641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.852779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.852908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.853941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.854188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.854397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.854530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.854657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.854784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.854912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.855041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.855177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.855322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.855451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.855580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.855708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.855835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856142 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.856957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.857084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.857226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.857354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.857490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.857618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.857776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.857912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.858956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.859092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.859223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.859350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.859484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.859612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.859745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.859899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.860971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.861100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.861235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.861370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.861507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.861641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.861770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.861899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.862946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.863082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.863211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.863346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.863475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.863603 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.863730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.863916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.864987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.865116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.865243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.865370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.865514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.865645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.865774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.865901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.866950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.867086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.867216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.867350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.867477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.867605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.867732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.867883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.868942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.869984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.870120 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.870249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.870384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.870512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.870640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.870768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.870903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.871945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.872982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.873109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.873245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.873403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.873539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.873666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.873808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.873991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.874155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.874286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.874414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.874543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.874670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.874797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.874932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.875067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.875195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.875334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.875468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.875636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.875778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.875976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.876113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.876242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.876371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.876500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.876641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.876770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.876898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.877952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.878079 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.878216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.878344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.878472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.878600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.878729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.878856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.879002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.879002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.879245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.879373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.879500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.879629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.879833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.880974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.881102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.881230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.881356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.881491 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.881621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.881747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.881876 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.882925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.883060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.883188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.883315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.883442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.883580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.883754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.883912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.884972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.885101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.885228 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.885364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.885492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.885626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.885755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.885882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.886957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.887086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.887214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.887340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.887467 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.887594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.887728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.887862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.888078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.888207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.888335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.888462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.888601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.888729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.888856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.889030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.889169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.889325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.889465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.889654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.889798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.889926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.890993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.891122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.891258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.891387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.891515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.891643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.891789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.891937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.892982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.893110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.893237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.893373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.893502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.893640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.893772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.893899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.894966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.895165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.895327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.895470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.895599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.895727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.895884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.896930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.897999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.898127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.898256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.898383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.898510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.898646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.898775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.898903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.899030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.899167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.899296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.899432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.899568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.899697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.899825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.900990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.901211 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.901350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.901485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.901619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.901754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.901889 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.902031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.902167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.902301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.902435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:39:16.902571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:39:16.902571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:39:16.916346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.916585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.916729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.916867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.917004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.917158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.925646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.925892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.954279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.954550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.954947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:16.955172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.008092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.008478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.059676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.060006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.060241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.060447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.127639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.127992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.128159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.128347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.128435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.128603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.128683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.128748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.128825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.129060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.129207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.129391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.152819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.152992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.153754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.154056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.154138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.154210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.154273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.165606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.166081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.180279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.180477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.180705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.180927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.181758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.182034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.182181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:39:17.198726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.198881 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:39:17.199251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.199391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.199465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:39:17.199528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:39:17.199800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.199923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.199992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.200069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:39:17.200313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.200397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.200460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.200520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.200759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.201035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.212452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.212580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.212790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.212876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.212959 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.213264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.213382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.213725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.221427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.225064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.225318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.225625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.226024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.226303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.226525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.226682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.226831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.227090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.227336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.227630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.227886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.229950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.230201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.230500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.230891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.231151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.231435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.232284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.232284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.232284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.232721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.232721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.254418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.256085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.256375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.259356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.261002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.261285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.261628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.261909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.262188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.266583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.266839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.267133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.269503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.269793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.274400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.274608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.274760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.274900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.274900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.275182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.275474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.275722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.276047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.276284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.279223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.279479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.279810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.280213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.280417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.280654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.280873 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.281154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.295025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.295306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.299619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.299845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.300041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.303528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.303821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.304385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.307983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.308274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.309110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.312875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.313234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.316616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.316851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.317008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.317152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.317468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.317752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.318043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.320544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.320832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.321112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.321396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.321615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.321921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.337000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.337380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.337626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.337917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.340714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.341085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.341334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.341615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.345826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.347549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.347798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.349934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.351188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.351476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.351697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.351934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.352093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.352236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.352375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.354916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.355148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.355448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.355742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.356020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.366206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.366454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.366760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.367047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.367333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.367582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.367907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.369825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.370078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.370380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.370639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.370936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.371190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.371485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.386078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.389408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.389620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.392850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.393053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.394447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.396124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.396366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.396366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.396707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.397704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.399299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.399548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.399900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.404042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.405881 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.407437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.409059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.409389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.409676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.409970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.410212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.412257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.412513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.412819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.413094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.419404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.419700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.419982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.422346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.422641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.422892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.428025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.428278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.428586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.428863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.429104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.429414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.429658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.429954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.430192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.430489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.430718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.430876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:39:17.431031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.431171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.431309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.431455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.431638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.431776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.431776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.432078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.432359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.432602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.432892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.433123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.433397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.433669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.433935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.434271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:39:17.475543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5600ab1a29c0 pid: 80254 (default app) May 13 14:39:17.475811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5600ab1a29c0 pid: 80255 (default app) May 13 14:39:17.475983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d26d-887e-4444-90b6-cf9a6341bdcc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:17.475983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d26d-887e-4444-90b6-cf9a6341bdcc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:17.475983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d26d-887e-4444-90b6-cf9a6341bdcc None None] PATH_INFO: `/v3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:17.479606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1/1] 10.222.0.99 () {50 vars in 791 bytes} [Fri May 13 14:39:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:25.473024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8e56-6ef3-4e3e-a336-0f29f1942dc6 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:25.473601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8e56-6ef3-4e3e-a336-0f29f1942dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:25.473601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b8e56-6ef3-4e3e-a336-0f29f1942dc6 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:25.478352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1/2] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:25.484112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:25.484620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:25.484620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:25.516300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG oslo_db.sqlalchemy.engines [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:39:25.700030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG passlib.handlers.bcrypt [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80254) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 14:39:25.700443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG passlib.handlers.bcrypt [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80254) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 14:39:25.756223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:25.757788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:25.892747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 2/3] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 13 14:39:26.060977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b8e56-6ef3-4e3e-a336-0f29f1942dc6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:26.096910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG oslo_db.sqlalchemy.engines [None req-2d9b8e56-6ef3-4e3e-a336-0f29f1942dc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:39:26.225636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b8e56-6ef3-4e3e-a336-0f29f1942dc6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:26.230454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40341c-d099-4a93-96b8-e5446288e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:26.231117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40341c-d099-4a93-96b8-e5446288e941 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:26.231402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40341c-d099-4a93-96b8-e5446288e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:26.231677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40341c-d099-4a93-96b8-e5446288e941 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:26.240096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40341c-d099-4a93-96b8-e5446288e941 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:26.291299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9e40341c-d099-4a93-96b8-e5446288e941 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 14:39:26.291646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40341c-d099-4a93-96b8-e5446288e941 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:26.302387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 2/4] 10.222.0.99 () {58 vars in 1324 bytes} [Fri May 13 14:39:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:39:26.308796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:26.323901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6238c-abdf-4d70-af76-c193442afe14 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:26.328733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3071ea-4df6-45d9-a5c6-e3e6cf14e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:26.329862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3071ea-4df6-45d9-a5c6-e3e6cf14e311 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:26.330142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3071ea-4df6-45d9-a5c6-e3e6cf14e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:26.330421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3071ea-4df6-45d9-a5c6-e3e6cf14e311 admin admin] PATH_INFO: `/v3/projects/874372a810af4de2a4ad12d67714243a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:26.332057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3071ea-4df6-45d9-a5c6-e3e6cf14e311 admin admin] RBAC: Authorizing `identity:get_project(project_id=874372a810af4de2a4ad12d67714243a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:26.383198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db3071ea-4df6-45d9-a5c6-e3e6cf14e311 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 14:39:26.383533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3071ea-4df6-45d9-a5c6-e3e6cf14e311 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:26.388204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 3/5] 10.222.0.99 () {56 vars in 1207 bytes} [Fri May 13 14:39:26 2022] GET /identity/v3/projects/874372a810af4de2a4ad12d67714243a => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:28.568911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8527da-b068-4c8f-b7f5-d3edcf0bfcb7 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:28.569770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8527da-b068-4c8f-b7f5-d3edcf0bfcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:28.569770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8527da-b068-4c8f-b7f5-d3edcf0bfcb7 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:28.576708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 3/6] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:28.583250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b555-bb14-4dcf-8b41-ae675a61e73a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:28.583989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b555-bb14-4dcf-8b41-ae675a61e73a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:28.584160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b555-bb14-4dcf-8b41-ae675a61e73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:28.609257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2c28b555-bb14-4dcf-8b41-ae675a61e73a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:28.610791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2c28b555-bb14-4dcf-8b41-ae675a61e73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:28.619692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 4/7] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 13 14:39:28.645476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8527da-b068-4c8f-b7f5-d3edcf0bfcb7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:28.667471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8527da-b068-4c8f-b7f5-d3edcf0bfcb7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:28.676585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3226dab-ca94-4308-98b7-bacb11d1fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:28.677555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226dab-ca94-4308-98b7-bacb11d1fb68 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:28.677872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226dab-ca94-4308-98b7-bacb11d1fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:28.678171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3226dab-ca94-4308-98b7-bacb11d1fb68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:28.692191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3226dab-ca94-4308-98b7-bacb11d1fb68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:28.695001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3226dab-ca94-4308-98b7-bacb11d1fb68 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:28.707395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 4/8] 10.222.0.99 () {58 vars in 1324 bytes} [Fri May 13 14:39:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:39:28.713161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28b555-bb14-4dcf-8b41-ae675a61e73a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:28.723053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28b555-bb14-4dcf-8b41-ae675a61e73a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:28.728430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd17de3-5cc1-4da5-9717-cf552f8a3394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:28.729299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd17de3-5cc1-4da5-9717-cf552f8a3394 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:28.729585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd17de3-5cc1-4da5-9717-cf552f8a3394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:28.729863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd17de3-5cc1-4da5-9717-cf552f8a3394 admin admin] PATH_INFO: `/v3/users/3521504b5b0e494782ca07b80f916dd3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:28.731308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd17de3-5cc1-4da5-9717-cf552f8a3394 admin admin] RBAC: Authorizing `identity:get_user(user_id=3521504b5b0e494782ca07b80f916dd3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:28.733375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd17de3-5cc1-4da5-9717-cf552f8a3394 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:28.734961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 5/9] 10.222.0.99 () {56 vars in 1198 bytes} [Fri May 13 14:39:28 2022] GET /identity/v3/users/3521504b5b0e494782ca07b80f916dd3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:31.002223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf3ea-a403-4b39-a955-953517c48b25 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.002773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf3ea-a403-4b39-a955-953517c48b25 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.002773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf3ea-a403-4b39-a955-953517c48b25 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.004276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 5/10] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:31.009681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f523b-619b-48ae-b7bf-87e44f32a039 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.010095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f523b-619b-48ae-b7bf-87e44f32a039 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.010199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f523b-619b-48ae-b7bf-87e44f32a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.068085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd65d3-7e94-46fc-b24a-01bdf7333305 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.068377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd65d3-7e94-46fc-b24a-01bdf7333305 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.068652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd65d3-7e94-46fc-b24a-01bdf7333305 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.070036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 6/11] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:31.076272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.076649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.076932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.118740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG passlib.handlers.bcrypt [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80255) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 14:39:31.119155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG passlib.handlers.bcrypt [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80255) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 14:39:31.139987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-715f523b-619b-48ae-b7bf-87e44f32a039 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:31.141202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-715f523b-619b-48ae-b7bf-87e44f32a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:31.165390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:31.166994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:31.222946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 6/12] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:31.246499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f523b-619b-48ae-b7bf-87e44f32a039 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.267318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 7/13] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:39:31.289068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.345615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f523b-619b-48ae-b7bf-87e44f32a039 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.379262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:31.380094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.380382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.380657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.393456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08237c-169e-4963-98cf-29539f48f427 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.394475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:31.406858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:31.407899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:39:31.408726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 7/14] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:31.414070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.429925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:31.430910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.431201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.431478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.501363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:31.502906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:31.514279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fecfcb-b9f6-4147-854f-f31b821baf2f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.547737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:31.548370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.548655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.548932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.549973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:31.550280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:31.551693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:31.564100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 8/15] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:31.569439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.597139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 8/16] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:39:31.603272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.669918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916e100-55b4-474a-8f84-9970dd1fcb56 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.699273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502262c-3e1f-4802-a709-241fa5405c1c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.704987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e514-1835-4581-9402-576f332158fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:31.705860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e514-1835-4581-9402-576f332158fa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.706143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e514-1835-4581-9402-576f332158fa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.706418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230e514-1835-4581-9402-576f332158fa None admin] PATH_INFO: `/v3/users/3521504b5b0e494782ca07b80f916dd3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.707621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e514-1835-4581-9402-576f332158fa None admin] RBAC: Authorizing `identity:get_user(user_id=3521504b5b0e494782ca07b80f916dd3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:31.709128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230e514-1835-4581-9402-576f332158fa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:31.710757 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 9/17] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/users/3521504b5b0e494782ca07b80f916dd3 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:31.716114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e514-1835-4581-9402-576f332158fa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.733469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:31.734295 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.734570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.734844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.819519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230e514-1835-4581-9402-576f332158fa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.859348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:31.860182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:31.860468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:31.860745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:31.861979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:31.863471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:31.863909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:31.865122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 10/18] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:31.865391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:31.870990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:39:31.886050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:31.886918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:31.887716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:39:31.887716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:39:31.887716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:39:31.887716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:31.887970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 9/19] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:31.894170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:31.966426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0376-ac6b-49c6-9315-e85b451fb01c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.994281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404179-ae21-4a01-a9d4-7888ce8fa6ee None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:31.999303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a92ad2-8fe5-47dd-8cc2-01e5d23be10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:32.000048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a92ad2-8fe5-47dd-8cc2-01e5d23be10e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:32.000349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a92ad2-8fe5-47dd-8cc2-01e5d23be10e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:32.000612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a92ad2-8fe5-47dd-8cc2-01e5d23be10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:32.001458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a92ad2-8fe5-47dd-8cc2-01e5d23be10e None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.domain.id=default, user.id=3521504b5b0e494782ca07b80f916dd3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:32.001768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a92ad2-8fe5-47dd-8cc2-01e5d23be10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:32.003322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a92ad2-8fe5-47dd-8cc2-01e5d23be10e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:32.010424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 11/20] 10.222.0.99 () {56 vars in 1322 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/role_assignments?user.id=3521504b5b0e494782ca07b80f916dd3&scope.domain.id=default&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:32.030200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b629ffc-061e-4309-8714-cb0135af4542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:32.030875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b629ffc-061e-4309-8714-cb0135af4542 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:32.031162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b629ffc-061e-4309-8714-cb0135af4542 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:32.031439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b629ffc-061e-4309-8714-cb0135af4542 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:32.032239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b629ffc-061e-4309-8714-cb0135af4542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:32.032550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b629ffc-061e-4309-8714-cb0135af4542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:32.033985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b629ffc-061e-4309-8714-cb0135af4542 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:32.054242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 10/21] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:34.551920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265808b6-8906-4f23-aa6b-7ef439edfdb0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:34.552915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265808b6-8906-4f23-aa6b-7ef439edfdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:34.553389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265808b6-8906-4f23-aa6b-7ef439edfdb0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:34.555267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 12/22] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:34.560449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e652159-ac78-46f2-bf2f-a7debe385809 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:34.561382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e652159-ac78-46f2-bf2f-a7debe385809 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:34.561871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e652159-ac78-46f2-bf2f-a7debe385809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:34.584105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6e652159-ac78-46f2-bf2f-a7debe385809 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:34.585640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6e652159-ac78-46f2-bf2f-a7debe385809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:34.667827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 11/23] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:34.684763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d7ab-f643-43f4-8c03-ed692a6c9469 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:34.685360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d7ab-f643-43f4-8c03-ed692a6c9469 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:34.685940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1d7ab-f643-43f4-8c03-ed692a6c9469 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:34.687614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 13/24] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:34.695281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e652159-ac78-46f2-bf2f-a7debe385809 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:34.699344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc289405-f00c-4856-a658-58612b2dadc7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:34.699947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc289405-f00c-4856-a658-58612b2dadc7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:34.700415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc289405-f00c-4856-a658-58612b2dadc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:34.733294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cc289405-f00c-4856-a658-58612b2dadc7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:34.735027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cc289405-f00c-4856-a658-58612b2dadc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:34.813319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e652159-ac78-46f2-bf2f-a7debe385809 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:34.826702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 14/25] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:34.853594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:34.854434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:34.854721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:34.854995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:34.871524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:34.873307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc289405-f00c-4856-a658-58612b2dadc7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:34.877565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:39:34.904565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:34.905454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:34.906262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:39:34.906262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:39:34.906262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:39:34.906262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:34.908414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 12/26] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:34.913905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:35.009032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc289405-f00c-4856-a658-58612b2dadc7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:35.045575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:35.051347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.051645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.051898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.062909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:35.070847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:35.071726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:39:35.072956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 15/27] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:35.079061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:35.115572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e8fa1-2c63-4534-ac41-23729a93f3ce None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:35.173235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91e87d-f93e-48ea-b3b1-f06b826d0419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:35.173907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91e87d-f93e-48ea-b3b1-f06b826d0419 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.174193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91e87d-f93e-48ea-b3b1-f06b826d0419 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.174476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91e87d-f93e-48ea-b3b1-f06b826d0419 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.175209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91e87d-f93e-48ea-b3b1-f06b826d0419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:35.175518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91e87d-f93e-48ea-b3b1-f06b826d0419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:35.176946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91e87d-f93e-48ea-b3b1-f06b826d0419 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:35.189919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 13/28] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:35.191295 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53fba-d873-45c3-ab77-e1e6d44e44fe None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.191584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53fba-d873-45c3-ab77-e1e6d44e44fe None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.191860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53fba-d873-45c3-ab77-e1e6d44e44fe None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.198356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 14/29] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:35.199555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988b02-3e66-41b8-a5da-05c4c1c8d03c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.199841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988b02-3e66-41b8-a5da-05c4c1c8d03c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.200144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988b02-3e66-41b8-a5da-05c4c1c8d03c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.209412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 15/30] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:35.209412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988b02-3e66-41b8-a5da-05c4c1c8d03c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:35.213202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a503ac-1391-4568-a885-8cdfdee2850c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:35.247737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735aa8-7884-4f01-ab25-1fcd5a4eb48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:35.248890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735aa8-7884-4f01-ab25-1fcd5a4eb48c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.249374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735aa8-7884-4f01-ab25-1fcd5a4eb48c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.250336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735aa8-7884-4f01-ab25-1fcd5a4eb48c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.251366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735aa8-7884-4f01-ab25-1fcd5a4eb48c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:35.251915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735aa8-7884-4f01-ab25-1fcd5a4eb48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:35.253651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735aa8-7884-4f01-ab25-1fcd5a4eb48c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:35.263687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 16/31] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:35.265581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698e45-3b06-45eb-bb7d-86db0552e55c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.266103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698e45-3b06-45eb-bb7d-86db0552e55c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.266569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698e45-3b06-45eb-bb7d-86db0552e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.283402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-de698e45-3b06-45eb-bb7d-86db0552e55c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:35.284941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-de698e45-3b06-45eb-bb7d-86db0552e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:35.317330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988b02-3e66-41b8-a5da-05c4c1c8d03c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:35.352340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:35.352915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.353114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.353301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 17/32] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:35.353401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.354321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:35.355076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a98bb-be4a-4a84-bb43-decf6e9a729c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.355558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a98bb-be4a-4a84-bb43-decf6e9a729c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.355770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:35.356230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a98bb-be4a-4a84-bb43-decf6e9a729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.380910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-481a98bb-be4a-4a84-bb43-decf6e9a729c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:35.382518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-481a98bb-be4a-4a84-bb43-decf6e9a729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:35.463973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 18/33] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:35.465183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a98bb-be4a-4a84-bb43-decf6e9a729c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:35.515610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 16/34] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:39:35 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:35.521201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:35.586846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a98bb-be4a-4a84-bb43-decf6e9a729c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:35.627365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:35.628708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.629284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.629749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] PATH_INFO: `/v3/users/3521504b5b0e494782ca07b80f916dd3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.631230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] RBAC: Authorizing `identity:get_user(user_id=3521504b5b0e494782ca07b80f916dd3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:35.633129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:35.635645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 19/35] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:35 2022] GET /identity/v3/users/3521504b5b0e494782ca07b80f916dd3 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:35.636753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:35.752938 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312428f7-2daa-490e-97cf-2a26bedda803 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:35.794129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388b9cc-6ea8-42ab-8fa9-c18342343ade None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:35.803352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:35.804076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.804385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.804629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.805399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:35.806848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:35.837762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:35.838989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:35.839524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:35.840047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:35.841100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:35.842986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:35.864897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 17/36] 10.222.0.99 () {60 vars in 1131 bytes} [Fri May 13 14:39:35 2022] POST /identity/v3/roles => generated 225 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:35.866049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:35.954070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 20/37] 10.222.0.99 () {60 vars in 1131 bytes} [Fri May 13 14:39:35 2022] POST /identity/v3/roles => generated 219 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:35.981630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7851cd8-accf-42c2-a75f-186a11c83af2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:36.023471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8669a-0335-42b4-9a5f-6a9d2cac1f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:36.024776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8669a-0335-42b4-9a5f-6a9d2cac1f7d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.025278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8669a-0335-42b4-9a5f-6a9d2cac1f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.025746 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8669a-0335-42b4-9a5f-6a9d2cac1f7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.027334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8669a-0335-42b4-9a5f-6a9d2cac1f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:36.029125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8669a-0335-42b4-9a5f-6a9d2cac1f7d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:36.031553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 18/38] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:36.037942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:36.165263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122134c7-3da7-4f3e-8e31-725d40fc08f7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:36.214335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554424f-0b4b-4bae-a78a-30c1d9a11a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:36.215272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554424f-0b4b-4bae-a78a-30c1d9a11a07 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.215559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554424f-0b4b-4bae-a78a-30c1d9a11a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.217477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554424f-0b4b-4bae-a78a-30c1d9a11a07 None admin] PATH_INFO: `/v3/domains/default/users/3521504b5b0e494782ca07b80f916dd3/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.219716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554424f-0b4b-4bae-a78a-30c1d9a11a07 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3521504b5b0e494782ca07b80f916dd3, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:36.220751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554424f-0b4b-4bae-a78a-30c1d9a11a07 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:36.236777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 21/39] 10.222.0.99 () {58 vars in 1361 bytes} [Fri May 13 14:39:36 2022] PUT /identity/v3/domains/default/users/3521504b5b0e494782ca07b80f916dd3/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:39:36.468317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a061e9-6b8b-45b7-800b-6b9448b0cdd6 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.468647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a061e9-6b8b-45b7-800b-6b9448b0cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.468816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a061e9-6b8b-45b7-800b-6b9448b0cdd6 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.470201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 19/40] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:36.476591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948dfba-ef45-443b-8461-ece1823e5a1e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.476876 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948dfba-ef45-443b-8461-ece1823e5a1e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.477178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948dfba-ef45-443b-8461-ece1823e5a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.495006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f948dfba-ef45-443b-8461-ece1823e5a1e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:36.496527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f948dfba-ef45-443b-8461-ece1823e5a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:36.510136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c7f5d-906b-41b2-985b-ce3b1c49902b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.510445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c7f5d-906b-41b2-985b-ce3b1c49902b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.510710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c7f5d-906b-41b2-985b-ce3b1c49902b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.512195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 20/41] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:39:36.518030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbefda-ab3e-420a-b588-75f656d70794 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.518321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbefda-ab3e-420a-b588-75f656d70794 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.518601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbefda-ab3e-420a-b588-75f656d70794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.535910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-58cbefda-ab3e-420a-b588-75f656d70794 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:36.537453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-58cbefda-ab3e-420a-b588-75f656d70794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:36.565924 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 22/42] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:36.588944 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948dfba-ef45-443b-8461-ece1823e5a1e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:36.604608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 21/43] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:39:36.626750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbefda-ab3e-420a-b588-75f656d70794 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:36.687850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948dfba-ef45-443b-8461-ece1823e5a1e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:36.722039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:36.722798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.723079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.723354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.723442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbefda-ab3e-420a-b588-75f656d70794 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:36.724574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:36.726432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:36.728304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 23/44] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:36.733754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:36.758489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f558d-db11-4350-b000-757c90107c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:36.759188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f558d-db11-4350-b000-757c90107c44 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.759485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f558d-db11-4350-b000-757c90107c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.759765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f558d-db11-4350-b000-757c90107c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.760563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f558d-db11-4350-b000-757c90107c44 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:36.761991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f558d-db11-4350-b000-757c90107c44 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:36.783917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 22/45] 10.222.0.99 () {60 vars in 1131 bytes} [Fri May 13 14:39:36 2022] POST /identity/v3/roles => generated 223 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:39:36.843547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0b536-8762-4c69-a053-ce99088c80fb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:36.879585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb400434-56ab-43b3-84d9-94fb0aca4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:36.880326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb400434-56ab-43b3-84d9-94fb0aca4484 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:36.880612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb400434-56ab-43b3-84d9-94fb0aca4484 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:36.880892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb400434-56ab-43b3-84d9-94fb0aca4484 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:36.881653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb400434-56ab-43b3-84d9-94fb0aca4484 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:36.883164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb400434-56ab-43b3-84d9-94fb0aca4484 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:36.914140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 24/46] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:39:36 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:39:38.492163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353276-48e3-4016-9075-79bfc62f8a6a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:38.492792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353276-48e3-4016-9075-79bfc62f8a6a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:38.492792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353276-48e3-4016-9075-79bfc62f8a6a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:38.494176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 23/47] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:38.500042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c99e1-cfae-47f0-ac8d-f4d5ba5fb9b7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:38.500522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c99e1-cfae-47f0-ac8d-f4d5ba5fb9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:38.500635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c99e1-cfae-47f0-ac8d-f4d5ba5fb9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:38.519982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-995c99e1-cfae-47f0-ac8d-f4d5ba5fb9b7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:38.521193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-995c99e1-cfae-47f0-ac8d-f4d5ba5fb9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:38.589650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 25/48] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:38.613130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353276-48e3-4016-9075-79bfc62f8a6a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:38.715095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353276-48e3-4016-9075-79bfc62f8a6a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:38.749330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:38.750056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:38.750343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:38.750623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:38.762710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:38.771446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:38.772406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:38.773370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 24/49] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:38.778671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c99e1-cfae-47f0-ac8d-f4d5ba5fb9b7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:38.880595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c99e1-cfae-47f0-ac8d-f4d5ba5fb9b7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:38.913910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:38.914602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:38.914863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:38.915137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:38.915898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:38.916226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:38.917638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:38.926333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 26/50] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:38.932115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:39.033632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d95dcd-c010-480f-93a5-1764f506ec66 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:39.070299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630710d-0ed7-411a-a185-af7e1a46a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:39.071205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630710d-0ed7-411a-a185-af7e1a46a98e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:39.071489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630710d-0ed7-411a-a185-af7e1a46a98e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:39.071766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630710d-0ed7-411a-a185-af7e1a46a98e None admin] PATH_INFO: `/v3/users/3521504b5b0e494782ca07b80f916dd3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:39.073303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630710d-0ed7-411a-a185-af7e1a46a98e None admin] RBAC: Authorizing `identity:get_user(user_id=3521504b5b0e494782ca07b80f916dd3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:39.074783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630710d-0ed7-411a-a185-af7e1a46a98e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:39.076717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 25/51] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:38 2022] GET /identity/v3/users/3521504b5b0e494782ca07b80f916dd3 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:39.082723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:39.188748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfda21-6924-4330-94a3-f176dc926509 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:39.204393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013b28b-f113-4074-8e5b-17959ab72892 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:39.204686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013b28b-f113-4074-8e5b-17959ab72892 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:39.204969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013b28b-f113-4074-8e5b-17959ab72892 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:39.206384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 26/52] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:39.211561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d099dc-98ce-44af-9c6f-b7111a215464 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:39.211850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d099dc-98ce-44af-9c6f-b7111a215464 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:39.212164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d099dc-98ce-44af-9c6f-b7111a215464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:39.226510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:39.227745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:39.228207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:39.228621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:39.230531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:39.233142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:39.234783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 27/53] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:39.236125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f0d099dc-98ce-44af-9c6f-b7111a215464 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:39.237322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f0d099dc-98ce-44af-9c6f-b7111a215464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:39.240680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:39.308011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 27/54] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:39.331695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d099dc-98ce-44af-9c6f-b7111a215464 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:39.338758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78935ed8-2f9d-4b45-baf7-b788f96f1551 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:39.373681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:39.374400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:39.374687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:39.374970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:39.375814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.domain.id=default, user.id=3521504b5b0e494782ca07b80f916dd3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:39.376149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:39.377656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:39.383576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 28/55] 10.222.0.99 () {56 vars in 1322 bytes} [Fri May 13 14:39:39 2022] GET /identity/v3/role_assignments?user.id=3521504b5b0e494782ca07b80f916dd3&scope.domain.id=default&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:39.432922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d099dc-98ce-44af-9c6f-b7111a215464 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:39.470555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4704d6a-e366-4054-adb8-0b15773e0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:39.471377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4704d6a-e366-4054-adb8-0b15773e0e0b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:39.471667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4704d6a-e366-4054-adb8-0b15773e0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:39.471974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4704d6a-e366-4054-adb8-0b15773e0e0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:39.474049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4704d6a-e366-4054-adb8-0b15773e0e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:39.476012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4704d6a-e366-4054-adb8-0b15773e0e0b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:39.477774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 28/56] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:39.483698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:39.590023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0c87f-e8b8-40c6-be71-f12f57705abc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:39.623685 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82c25-5fd5-44e9-ab4f-9d2593dd69d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:39.624444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82c25-5fd5-44e9-ab4f-9d2593dd69d1 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:39.624736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82c25-5fd5-44e9-ab4f-9d2593dd69d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:39.625017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82c25-5fd5-44e9-ab4f-9d2593dd69d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:39.625728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d82c25-5fd5-44e9-ab4f-9d2593dd69d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:39.627220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d82c25-5fd5-44e9-ab4f-9d2593dd69d1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:39.653714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 29/57] 10.222.0.99 () {60 vars in 1140 bytes} [Fri May 13 14:39:39 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:41.856871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191caf06-d59d-4e20-be46-285002b31c62 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:41.857646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191caf06-d59d-4e20-be46-285002b31c62 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:41.857646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191caf06-d59d-4e20-be46-285002b31c62 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:41.860060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 29/58] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:41.866287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a341ca-0100-4d97-93dd-8183a6a386ca None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:41.866950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a341ca-0100-4d97-93dd-8183a6a386ca None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:41.867220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a341ca-0100-4d97-93dd-8183a6a386ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:41.887731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-32a341ca-0100-4d97-93dd-8183a6a386ca None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:41.889016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-32a341ca-0100-4d97-93dd-8183a6a386ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:41.968340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 30/59] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:41.994215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191caf06-d59d-4e20-be46-285002b31c62 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:42.102129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191caf06-d59d-4e20-be46-285002b31c62 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:42.136249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c161bc-2105-4703-93bd-b159af510f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:42.136972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c161bc-2105-4703-93bd-b159af510f09 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:42.137264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c161bc-2105-4703-93bd-b159af510f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:42.137546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c161bc-2105-4703-93bd-b159af510f09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:42.138835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c161bc-2105-4703-93bd-b159af510f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:42.140565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c161bc-2105-4703-93bd-b159af510f09 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:42.142183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 30/60] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:42.151437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a341ca-0100-4d97-93dd-8183a6a386ca None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:42.260504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a341ca-0100-4d97-93dd-8183a6a386ca None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:42.296625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a39e86-50d4-4527-84b6-59370e3911ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:42.297290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a39e86-50d4-4527-84b6-59370e3911ef None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:42.297570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a39e86-50d4-4527-84b6-59370e3911ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:42.297848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a39e86-50d4-4527-84b6-59370e3911ef None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:42.298547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a39e86-50d4-4527-84b6-59370e3911ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:42.300055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a39e86-50d4-4527-84b6-59370e3911ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:42.330864 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 31/61] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:39:42 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:45.741298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766f068-ff87-4160-9ebe-6a74aa9b6fb0 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:45.742190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766f068-ff87-4160-9ebe-6a74aa9b6fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:45.742628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766f068-ff87-4160-9ebe-6a74aa9b6fb0 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:45.744688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 31/62] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:45.750325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf1da-d258-4df1-a1a2-e6ba6dc6a30c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:45.751320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf1da-d258-4df1-a1a2-e6ba6dc6a30c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:45.751827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf1da-d258-4df1-a1a2-e6ba6dc6a30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:45.777325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8faaf1da-d258-4df1-a1a2-e6ba6dc6a30c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:45.778875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8faaf1da-d258-4df1-a1a2-e6ba6dc6a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:45.874195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 32/63] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:45.904236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766f068-ff87-4160-9ebe-6a74aa9b6fb0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.010253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485507a9-4cdb-4973-9d8e-02919594806e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.010574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485507a9-4cdb-4973-9d8e-02919594806e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.012994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485507a9-4cdb-4973-9d8e-02919594806e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.012994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 33/64] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:39:46.019486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6adfd0-f875-4f21-ac1a-dd45f3b91c5f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.019486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6adfd0-f875-4f21-ac1a-dd45f3b91c5f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.019486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6adfd0-f875-4f21-ac1a-dd45f3b91c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.045315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4d6adfd0-f875-4f21-ac1a-dd45f3b91c5f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:46.046455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4d6adfd0-f875-4f21-ac1a-dd45f3b91c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:46.052660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766f068-ff87-4160-9ebe-6a74aa9b6fb0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.120513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.121775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.122255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.122722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.139168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:46.151360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:46.152304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:46.153136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:46.154633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 34/65] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:39:46.156215 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bee50-4139-423b-bb92-05df5755bd6e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.156758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bee50-4139-423b-bb92-05df5755bd6e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.157228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bee50-4139-423b-bb92-05df5755bd6e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.163112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 35/66] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:46.164354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 32/67] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:46.164706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc411-0080-4c01-8a5b-ee53fd23e553 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.165084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc411-0080-4c01-8a5b-ee53fd23e553 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.165436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc411-0080-4c01-8a5b-ee53fd23e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.173797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.191980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-765fc411-0080-4c01-8a5b-ee53fd23e553 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:46.193476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-765fc411-0080-4c01-8a5b-ee53fd23e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:46.259363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 36/68] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:46.260516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fc411-0080-4c01-8a5b-ee53fd23e553 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.290780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0d51-a094-487f-a0a9-b3c3faad0934 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.322867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9544d2a-72b8-4f04-875e-ecf6d678f612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.323460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544d2a-72b8-4f04-875e-ecf6d678f612 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.323744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544d2a-72b8-4f04-875e-ecf6d678f612 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.324052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544d2a-72b8-4f04-875e-ecf6d678f612 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.324807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9544d2a-72b8-4f04-875e-ecf6d678f612 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:46.325117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9544d2a-72b8-4f04-875e-ecf6d678f612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:46.326512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9544d2a-72b8-4f04-875e-ecf6d678f612 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:46.338181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 33/69] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:46.339483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef35f-29bc-4c76-b359-d56965716685 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.339773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef35f-29bc-4c76-b359-d56965716685 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.340080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef35f-29bc-4c76-b359-d56965716685 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.341276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 34/70] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:46.342123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ef35f-29bc-4c76-b359-d56965716685 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.358426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fc411-0080-4c01-8a5b-ee53fd23e553 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.390731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e3db-ad99-479d-bbcf-2e4e381f7683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.391556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e3db-ad99-479d-bbcf-2e4e381f7683 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.391838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e3db-ad99-479d-bbcf-2e4e381f7683 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.392140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e3db-ad99-479d-bbcf-2e4e381f7683 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.402046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9e3db-ad99-479d-bbcf-2e4e381f7683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c0e9e3db-ad99-479d-bbcf-2e4e381f7683 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:46.410135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:46.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:39:46.411948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 37/71] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:46.413059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb1f2-2bcb-426e-82ad-484cd1fff18c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.413059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb1f2-2bcb-426e-82ad-484cd1fff18c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.413059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb1f2-2bcb-426e-82ad-484cd1fff18c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.414278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 38/72] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:46.414961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb1f2-2bcb-426e-82ad-484cd1fff18c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.442119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ef35f-29bc-4c76-b359-d56965716685 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.477358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d5c9c-f086-4d1f-a0d8-b810e83ab698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.478286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5c9c-f086-4d1f-a0d8-b810e83ab698 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.478582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5c9c-f086-4d1f-a0d8-b810e83ab698 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.478923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5c9c-f086-4d1f-a0d8-b810e83ab698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.489828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d5c9c-f086-4d1f-a0d8-b810e83ab698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e05d5c9c-f086-4d1f-a0d8-b810e83ab698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:46.497620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:46.498508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:46.499255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 35/73] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:46.500234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289a21c-b4fd-4a33-8dc2-39e085a0f038 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.501064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289a21c-b4fd-4a33-8dc2-39e085a0f038 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.501064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289a21c-b4fd-4a33-8dc2-39e085a0f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.517254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6289a21c-b4fd-4a33-8dc2-39e085a0f038 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:46.518452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6289a21c-b4fd-4a33-8dc2-39e085a0f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:46.527334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb1f2-2bcb-426e-82ad-484cd1fff18c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.560886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.561760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.562045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.562319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.575621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:46.577084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:46.578883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 39/74] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:46.579655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.584847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 36/75] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:46.586245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6427-5651-401f-bd20-9fc3f5824ccd None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.586541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6427-5651-401f-bd20-9fc3f5824ccd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.586817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e6427-5651-401f-bd20-9fc3f5824ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.614837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-be9e6427-5651-401f-bd20-9fc3f5824ccd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:46.616036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-be9e6427-5651-401f-bd20-9fc3f5824ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:46.676264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd8646-67d5-4a2d-a598-76916befb1c5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.680880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 37/76] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:46.696095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e6427-5651-401f-bd20-9fc3f5824ccd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.709945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.710612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.710894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.711167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.711931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:46.712247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:46.713676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:46.721791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 40/77] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:46.722601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.777557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e6427-5651-401f-bd20-9fc3f5824ccd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.809431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.810102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.810386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.810674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.811431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:46.811749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:46.813389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:46.813970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d2c32-208c-4e22-97ec-23a102bcf1c1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.821627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 38/78] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:46.826452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:46.851427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.852151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.852440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.852722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.916999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575a109-ae06-4581-931c-2b9c1d3d1385 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:46.920843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:46.922885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:46.948557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:46.949380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:46.949661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:46.949934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:46.959907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:46.967377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:46.968343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:46.969175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 39/79] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:46.969800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.020180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 41/80] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:47.021070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.068112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df682d-d0b5-4a9d-9860-eaf40fe367ae None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.100897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.101666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.101949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.102236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.103426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.104916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.106828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 40/81] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.107583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.116328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275051ec-34b4-491b-ae6f-a2460a1131ef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.151177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.152095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.152384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.152660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.153899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.155377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.157409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 42/82] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.157971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.200450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2493fa-b8c4-49b1-84d7-cde302eb9cae None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.234088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.235079 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.235365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.235645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] PATH_INFO: `/v3/users/3521504b5b0e494782ca07b80f916dd3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.236903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=3521504b5b0e494782ca07b80f916dd3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.238360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.240349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 41/83] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/users/3521504b5b0e494782ca07b80f916dd3 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.241202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.257271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84793a-ad4e-47cb-9ba7-248eebb1a7ba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.291229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.291966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.292255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.292531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.293297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:47.293608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.295052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.303282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 43/84] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.304082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.334787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de505-1944-4650-8fbf-9e3f0eb12ef5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.368255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.369071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.369363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.369645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.370999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.372511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.374268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 42/85] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.375502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.401316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654f60-4927-47e9-b02d-72b965166469 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.433773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.434513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.434803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.435083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.435773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.437280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.459961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 44/86] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:39:47 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:47.460768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.480262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536802b7-ee6e-4e01-87a1-076184a67e59 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.517227 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.517903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.518161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.518443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.591220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58830a0-6704-4c35-bca0-c0c65dae45b7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.591452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.592822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.627820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.628434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.628720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.629062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.692019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 43/87] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:47.692986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.702359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.704596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.793064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a415-a0fe-4236-87d9-ae233984abf3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.816720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 45/88] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:47.817631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.835281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.836564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.837018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.837451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.838874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.840563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.842398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 44/89] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.843345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.920779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f5c02-03ac-4e7b-b0ad-855fe007b3b8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.942078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ab4a-eab6-47f0-bac1-7d1188b5d91a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:47.954786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.955458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.955743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.956048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.956890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=fd33b2c007f946f2967e45b02ef6025f) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:47.957202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.958668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.964711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 46/90] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/role_assignments?user.id=fd33b2c007f946f2967e45b02ef6025f&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.965545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:47.985284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:47.986209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:47.986496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:47.986779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:47.990308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:47.991839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:47.993748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 45/91] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:47.994576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:48.133322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861827cb-1f9b-4801-8702-7d6ee3d23980 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:48.169992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513b639-5c1d-4b5f-bd35-00a319a8d93d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:48.182982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:48.183793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:48.184212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:48.184491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:48.185697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:48.187172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:48.189276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 47/92] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:48.190061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:48.210406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:48.211075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:48.211400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:48.211637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:48.307026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9fea-a4ba-409a-8913-ff9b6671c1df None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:48.333844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:48.338406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:48.365025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:48.366055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:48.366530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:48.366996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:48.368080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] RBAC: Adding query filter params (role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=fd33b2c007f946f2967e45b02ef6025f) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:48.368587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:48.370267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:48.385778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 48/93] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:48 2022] GET /identity/v3/role_assignments?user.id=fd33b2c007f946f2967e45b02ef6025f&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=926ac669ff214536b6ec0876b5669dbc => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:48.388122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:48.539315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c4d1-33fb-4e5d-8851-6e31a028b69b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:48.579154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:48.580296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:48.581390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:48.581930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:48.583112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=3521504b5b0e494782ca07b80f916dd3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:48.583627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:48.585727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:48.592937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 49/94] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:48 2022] GET /identity/v3/role_assignments?user.id=3521504b5b0e494782ca07b80f916dd3&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:48.595994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 46/95] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:48.602115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:48.729844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1f12-690c-43f0-83b2-0b4e4fedf824 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:48.764877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda777d-4f9f-4156-bf22-3b1fc8023b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:48.765848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda777d-4f9f-4156-bf22-3b1fc8023b3f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:48.766136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda777d-4f9f-4156-bf22-3b1fc8023b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:48.766412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda777d-4f9f-4156-bf22-3b1fc8023b3f None admin] PATH_INFO: `/v3/projects/afa6a2d966254b22978fce772702714c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:48.767828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda777d-4f9f-4156-bf22-3b1fc8023b3f None admin] RBAC: Authorizing `identity:get_project(project_id=afa6a2d966254b22978fce772702714c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:48.769470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda777d-4f9f-4156-bf22-3b1fc8023b3f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:48.771681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 50/96] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:48 2022] GET /identity/v3/projects/afa6a2d966254b22978fce772702714c => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:48.781520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:48.906715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161100e-b6f4-4909-b3ff-5aed53350bf5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:48.941719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e837d-831e-47bc-a509-3e63db07e10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:48.942625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e837d-831e-47bc-a509-3e63db07e10b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:48.943079 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e837d-831e-47bc-a509-3e63db07e10b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:48.943494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e837d-831e-47bc-a509-3e63db07e10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:48.944506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e837d-831e-47bc-a509-3e63db07e10b None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=afa6a2d966254b22978fce772702714c, user.id=fd33b2c007f946f2967e45b02ef6025f) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:48.944955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e837d-831e-47bc-a509-3e63db07e10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:48.946542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e837d-831e-47bc-a509-3e63db07e10b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:48.955423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 47/97] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:48 2022] GET /identity/v3/role_assignments?user.id=fd33b2c007f946f2967e45b02ef6025f&scope.project.id=afa6a2d966254b22978fce772702714c&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:50.233169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4a69a-5142-412a-9db0-63e4d8986eb3 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:50.234218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4a69a-5142-412a-9db0-63e4d8986eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:50.235218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4a69a-5142-412a-9db0-63e4d8986eb3 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:50.237135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 51/98] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:50.242468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a7875-a347-4121-ab4d-64bfe9555a87 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:50.242905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a7875-a347-4121-ab4d-64bfe9555a87 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:50.243075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a7875-a347-4121-ab4d-64bfe9555a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:50.265445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ae6a7875-a347-4121-ab4d-64bfe9555a87 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:50.266624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ae6a7875-a347-4121-ab4d-64bfe9555a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:50.359218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 48/99] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:50.399382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4a69a-5142-412a-9db0-63e4d8986eb3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:50.544880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4a69a-5142-412a-9db0-63e4d8986eb3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:50.585431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651e21c-e20e-4613-b2de-149cc4063649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:50.586263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e21c-e20e-4613-b2de-149cc4063649 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:50.586552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e21c-e20e-4613-b2de-149cc4063649 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:50.586828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e21c-e20e-4613-b2de-149cc4063649 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:50.609073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651e21c-e20e-4613-b2de-149cc4063649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e651e21c-e20e-4613-b2de-149cc4063649 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:50.616840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:50.617732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:39:50.618503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 52/100] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:50.624627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a7875-a347-4121-ab4d-64bfe9555a87 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:50.641583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da883b8f-5bb7-48cd-9916-eaf702511631 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:50.641583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da883b8f-5bb7-48cd-9916-eaf702511631 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:50.641583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da883b8f-5bb7-48cd-9916-eaf702511631 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:50.643235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 53/101] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:39:50.669290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94553a3-f471-4661-925f-eb0509070383 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:50.669879 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94553a3-f471-4661-925f-eb0509070383 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:50.670316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94553a3-f471-4661-925f-eb0509070383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:50.696875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c94553a3-f471-4661-925f-eb0509070383 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:50.698341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c94553a3-f471-4661-925f-eb0509070383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:50.739136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a7875-a347-4121-ab4d-64bfe9555a87 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:50.778021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:50.779181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:50.779663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:50.780155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:50.781270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:50.781811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:50.783445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:50.793333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 54/102] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:39:50.795125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 49/103] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:50.800851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94553a3-f471-4661-925f-eb0509070383 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:50.832934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:50.952106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2200d-b65c-40da-b606-f31b02d712a5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:50.964497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94553a3-f471-4661-925f-eb0509070383 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:50.993935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87967171-906a-46e9-a7e3-5aa950ddd0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:50.995126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87967171-906a-46e9-a7e3-5aa950ddd0dd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:50.995620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87967171-906a-46e9-a7e3-5aa950ddd0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:50.996141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87967171-906a-46e9-a7e3-5aa950ddd0dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.000570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87967171-906a-46e9-a7e3-5aa950ddd0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:51.002251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87967171-906a-46e9-a7e3-5aa950ddd0dd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:51.004240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 50/104] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:51.010949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3bfea-776a-4760-8c17-f1d0b1cf0c1a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.011114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a8045-1a28-4ec4-a5ae-9d4ff03560da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:51.011649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3bfea-776a-4760-8c17-f1d0b1cf0c1a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.012155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3bfea-776a-4760-8c17-f1d0b1cf0c1a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.012263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8045-1a28-4ec4-a5ae-9d4ff03560da None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.012487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8045-1a28-4ec4-a5ae-9d4ff03560da None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.012790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8045-1a28-4ec4-a5ae-9d4ff03560da None admin] PATH_INFO: `/v3/users/214c0078b2d6447084e245af3dabb827` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.014344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 51/105] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:39:51.015257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3bfea-776a-4760-8c17-f1d0b1cf0c1a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:51.041959 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a8045-1a28-4ec4-a5ae-9d4ff03560da None admin] RBAC: Authorizing `identity:get_user(user_id=214c0078b2d6447084e245af3dabb827)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:51.043382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a8045-1a28-4ec4-a5ae-9d4ff03560da None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:51.045149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 55/106] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:50 2022] GET /identity/v3/users/214c0078b2d6447084e245af3dabb827 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:51.047332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256c433-f445-4087-8837-c49dafe086fa None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.047616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256c433-f445-4087-8837-c49dafe086fa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.047900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256c433-f445-4087-8837-c49dafe086fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.076020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2256c433-f445-4087-8837-c49dafe086fa None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:51.077198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2256c433-f445-4087-8837-c49dafe086fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:51.167142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 56/107] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:51.173290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256c433-f445-4087-8837-c49dafe086fa None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:51.232882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3bfea-776a-4760-8c17-f1d0b1cf0c1a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:51.293401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:51.294267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.294724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.295167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.296105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:51.297699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:51.308546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256c433-f445-4087-8837-c49dafe086fa None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:51.353725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:51.354751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.355281 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.355399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 52/108] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:39:51 2022] POST /identity/v3/projects => generated 302 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:51.355916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.356691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:51.465470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:51.467737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:51.590494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8748021-4826-4fb0-bb5b-6a51e37ddd8c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:51.616058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 57/109] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:51.626877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:51.672592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:51.673418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.673704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.673975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.689377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:51.706588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:51.718529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:51.720443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 53/110] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:51.732076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:51.808267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a7cb2-8b96-486f-a20d-8239dd235dab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:51.885059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004d01c-0490-44c9-82db-558c37d1c461 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:51.896369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93242c98-1bd7-41be-8653-d3c6e8a4dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:51.897255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242c98-1bd7-41be-8653-d3c6e8a4dce3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.897777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242c98-1bd7-41be-8653-d3c6e8a4dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.897892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242c98-1bd7-41be-8653-d3c6e8a4dce3 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.899043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93242c98-1bd7-41be-8653-d3c6e8a4dce3 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:51.900573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93242c98-1bd7-41be-8653-d3c6e8a4dce3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:51.902656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 58/111] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:51 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:51.903984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626bc58-0ffa-44ff-89ab-749a5923b525 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.904277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626bc58-0ffa-44ff-89ab-749a5923b525 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.904563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626bc58-0ffa-44ff-89ab-749a5923b525 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.905821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 59/112] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:51.908967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626bc58-0ffa-44ff-89ab-749a5923b525 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:51.933695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e2cd4-f1e4-46e1-9bcb-434dae8c9f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:51.934834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e2cd4-f1e4-46e1-9bcb-434dae8c9f90 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.935127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e2cd4-f1e4-46e1-9bcb-434dae8c9f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.935424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e2cd4-f1e4-46e1-9bcb-434dae8c9f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.936209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e2cd4-f1e4-46e1-9bcb-434dae8c9f90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:51.936521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e2cd4-f1e4-46e1-9bcb-434dae8c9f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:51.937945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e2cd4-f1e4-46e1-9bcb-434dae8c9f90 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:51.948430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 54/113] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:51.949912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6955-0d19-4ddd-aa2c-5b8cf4b0a71f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:51.950394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6955-0d19-4ddd-aa2c-5b8cf4b0a71f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:51.950897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6955-0d19-4ddd-aa2c-5b8cf4b0a71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:51.984622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8c4c6955-0d19-4ddd-aa2c-5b8cf4b0a71f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:51.986587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8c4c6955-0d19-4ddd-aa2c-5b8cf4b0a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:52.049895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626bc58-0ffa-44ff-89ab-749a5923b525 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.072798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 55/114] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:52.074224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c6955-0d19-4ddd-aa2c-5b8cf4b0a71f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.097529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.098203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.098491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.098770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.099678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] RBAC: Adding query filter params (role.id=fddd0c1720504ccb8fe2783b65becad0, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=214c0078b2d6447084e245af3dabb827) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:52.100388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:52.101960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:52.108981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 60/115] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:51 2022] GET /identity/v3/role_assignments?user.id=214c0078b2d6447084e245af3dabb827&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=fddd0c1720504ccb8fe2783b65becad0 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:52.126820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.219045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c6955-0d19-4ddd-aa2c-5b8cf4b0a71f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.237019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84623fa2-4e5a-4a3e-a2c8-775f7d765320 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.273051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.273286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.273935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.274038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.274212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.274311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.274488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.274579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.275834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:52.277336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:52.279426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 56/116] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:52 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:52.285185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.289692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:52.298191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:52.300731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:39:52.302566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 61/117] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:39:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:52.308217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.460736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22587d-159c-45c1-9ac6-8e12a32ffe71 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.470509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe8f6-7e6f-43fd-9316-f166c343834a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.526201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.526891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.527174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.527450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.528249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:52.528560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:52.529983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:52.533111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce13a9a-2eb7-47d4-a710-cd55d56a14bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.533985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce13a9a-2eb7-47d4-a710-cd55d56a14bb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.534414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce13a9a-2eb7-47d4-a710-cd55d56a14bb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.534695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce13a9a-2eb7-47d4-a710-cd55d56a14bb None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.536618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce13a9a-2eb7-47d4-a710-cd55d56a14bb None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:52.538182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce13a9a-2eb7-47d4-a710-cd55d56a14bb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:52.539944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 57/118] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:52 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:52.545162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af1261-5b9f-4f16-9d74-6315f445d8db None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.545436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af1261-5b9f-4f16-9d74-6315f445d8db None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.545722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af1261-5b9f-4f16-9d74-6315f445d8db None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.547475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 58/119] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:52.551195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 62/120] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:39:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:52.553042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bf61-51c2-462f-ab08-9448c3d89026 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.553339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bf61-51c2-462f-ab08-9448c3d89026 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.553625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bf61-51c2-462f-ab08-9448c3d89026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.557490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.576968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b537bf61-51c2-462f-ab08-9448c3d89026 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:52.578278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b537bf61-51c2-462f-ab08-9448c3d89026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:52.667523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 59/121] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 13 14:39:52.671198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bf61-51c2-462f-ab08-9448c3d89026 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.726799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3b980-0e79-4664-b004-ca605160d62f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.759234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cede23-2cc8-416e-8a7a-c023b8bd21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.760160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cede23-2cc8-416e-8a7a-c023b8bd21a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.760438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cede23-2cc8-416e-8a7a-c023b8bd21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.760709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cede23-2cc8-416e-8a7a-c023b8bd21a6 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f/users/fd33b2c007f946f2967e45b02ef6025f/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.763000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cede23-2cc8-416e-8a7a-c023b8bd21a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=41cd21a482424d49974c940f0f74a43f, user_id=fd33b2c007f946f2967e45b02ef6025f, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:52.764576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cede23-2cc8-416e-8a7a-c023b8bd21a6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:52.779369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 63/122] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:39:52 2022] PUT /identity/v3/projects/41cd21a482424d49974c940f0f74a43f/users/fd33b2c007f946f2967e45b02ef6025f/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:39:52.780616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d9a1-50ed-471c-b1b3-eba9086f075c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.780933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d9a1-50ed-471c-b1b3-eba9086f075c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.781318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d9a1-50ed-471c-b1b3-eba9086f075c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.787484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 64/123] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:52.788656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d9a1-50ed-471c-b1b3-eba9086f075c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.817268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bf61-51c2-462f-ab08-9448c3d89026 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.899421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d9a1-50ed-471c-b1b3-eba9086f075c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:52.904573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94d2e1-b0c7-4ace-b9eb-3dc8def34b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.905763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94d2e1-b0c7-4ace-b9eb-3dc8def34b52 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.906308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94d2e1-b0c7-4ace-b9eb-3dc8def34b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.906781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94d2e1-b0c7-4ace-b9eb-3dc8def34b52 None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.911235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94d2e1-b0c7-4ace-b9eb-3dc8def34b52 None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:52.913008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94d2e1-b0c7-4ace-b9eb-3dc8def34b52 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:52.914927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 60/124] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:52 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:52.916368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad768-863e-459f-a461-122b71096346 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.916852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad768-863e-459f-a461-122b71096346 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.917340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad768-863e-459f-a461-122b71096346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.934297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:52.935084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:52.935366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:52.935639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:52.946860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:52.954980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:52.955884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:39:52.956642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 65/125] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:52.957264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:52.958919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f03ad768-863e-459f-a461-122b71096346 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:52.960356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f03ad768-863e-459f-a461-122b71096346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:53.061058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21ab85-b438-43d6-bb44-8ddfe6193856 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.100294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.101417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.101704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.101972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.103144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:53.104473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 61/126] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:53.104998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:53.105463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ad768-863e-459f-a461-122b71096346 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.106682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 66/127] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:52 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:53.112466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.222725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a968c-24f4-4fee-b366-b8a832fdbd87 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.223924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ad768-863e-459f-a461-122b71096346 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.263226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66227248-f37d-4131-8582-3e64416b892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.264498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66227248-f37d-4131-8582-3e64416b892c None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.264882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66227248-f37d-4131-8582-3e64416b892c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.265170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66227248-f37d-4131-8582-3e64416b892c None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f/users/fd33b2c007f946f2967e45b02ef6025f/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.265567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.266429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.266816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.267157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.267670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66227248-f37d-4131-8582-3e64416b892c None admin] RBAC: Authorizing `identity:create_grant(project_id=41cd21a482424d49974c940f0f74a43f, user_id=fd33b2c007f946f2967e45b02ef6025f, role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:53.268347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:53.268655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:53.269250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66227248-f37d-4131-8582-3e64416b892c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:53.270062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:53.282127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 62/128] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:53.283170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.292839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 67/129] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:39:53 2022] PUT /identity/v3/projects/41cd21a482424d49974c940f0f74a43f/users/fd33b2c007f946f2967e45b02ef6025f/roles/926ac669ff214536b6ec0876b5669dbc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:39:53.293928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66227248-f37d-4131-8582-3e64416b892c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.420351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda273f1-0b78-4e39-9c68-c3f40324fe8b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.422356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66227248-f37d-4131-8582-3e64416b892c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.461038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.461851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.462131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.462408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.488367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:53.502638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:53.503554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:53.504372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:53.505038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.505038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.505038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.505558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] PATH_INFO: `/v3/users/3521504b5b0e494782ca07b80f916dd3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.507763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] RBAC: Authorizing `identity:get_user(user_id=3521504b5b0e494782ca07b80f916dd3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:53.507903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:53.511205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 68/130] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:53 2022] GET /identity/v3/users/3521504b5b0e494782ca07b80f916dd3 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:53.511340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 63/131] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:39:53.519896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.520136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.691513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e0d00-e0bc-4f8c-aed1-df426a256069 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.712077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f3923-d150-4b73-aae3-4bf30352ced4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.750740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.752629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.752916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.753193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.754185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:53.754494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:53.757998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:53.773632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.774567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.774860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.775139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.775932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 69/132] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:53.776428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:53.777996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:53.779969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 64/133] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:53 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:53.781660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.786178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:53.935290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478731-8ed7-4d96-a2d9-ccab35be645f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.974041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb25f-cc48-4700-bd3f-ea43d24b142c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:53.984233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:53.985480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:53.986384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:53.986885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f/users/3521504b5b0e494782ca07b80f916dd3/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:53.991279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] RBAC: Authorizing `identity:create_grant(project_id=41cd21a482424d49974c940f0f74a43f, user_id=3521504b5b0e494782ca07b80f916dd3, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:53.994065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:54.022465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 65/134] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:39:53 2022] PUT /identity/v3/projects/41cd21a482424d49974c940f0f74a43f/users/3521504b5b0e494782ca07b80f916dd3/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:39:54.035618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:54.037000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:54.037490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:54.037989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:54.039445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:54.041177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:54.043028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 70/135] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:53 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:54.048747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:54.173493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e1892-bc96-401b-a027-d6fca9bdca52 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:54.217606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7ca3c-7aa4-481f-b01d-a410e08e4af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:54.218931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ca3c-7aa4-481f-b01d-a410e08e4af8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:54.219515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ca3c-7aa4-481f-b01d-a410e08e4af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:54.220064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ca3c-7aa4-481f-b01d-a410e08e4af8 None admin] PATH_INFO: `/v3/projects/afa6a2d966254b22978fce772702714c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:54.225219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7ca3c-7aa4-481f-b01d-a410e08e4af8 None admin] RBAC: Authorizing `identity:get_project(project_id=afa6a2d966254b22978fce772702714c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:54.227050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7ca3c-7aa4-481f-b01d-a410e08e4af8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:54.229160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 66/136] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:54 2022] GET /identity/v3/projects/afa6a2d966254b22978fce772702714c => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:54.235596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:54.340850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f6690-c773-41b2-a32f-abb887371efc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:54.385172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110c209-c6d6-4d55-9226-89f2fef4d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:54.386456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c209-c6d6-4d55-9226-89f2fef4d863 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:54.386979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c209-c6d6-4d55-9226-89f2fef4d863 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:54.387461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c209-c6d6-4d55-9226-89f2fef4d863 None admin] PATH_INFO: `/v3/projects/afa6a2d966254b22978fce772702714c/users/fd33b2c007f946f2967e45b02ef6025f/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:54.389734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110c209-c6d6-4d55-9226-89f2fef4d863 None admin] RBAC: Authorizing `identity:create_grant(project_id=afa6a2d966254b22978fce772702714c, user_id=fd33b2c007f946f2967e45b02ef6025f, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:54.391765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110c209-c6d6-4d55-9226-89f2fef4d863 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:54.409883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 71/137] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:39:54 2022] PUT /identity/v3/projects/afa6a2d966254b22978fce772702714c/users/fd33b2c007f946f2967e45b02ef6025f/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:39:54.952359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884baae9-b728-4044-ab84-5d3b9c2435b9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:54.952972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884baae9-b728-4044-ab84-5d3b9c2435b9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:54.952972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884baae9-b728-4044-ab84-5d3b9c2435b9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:54.954730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 67/138] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:54.960668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dcdfb-f8db-47fd-8364-391e457c7e98 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:54.961399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dcdfb-f8db-47fd-8364-391e457c7e98 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:54.961399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dcdfb-f8db-47fd-8364-391e457c7e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:54.982728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0f3dcdfb-f8db-47fd-8364-391e457c7e98 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:54.983933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0f3dcdfb-f8db-47fd-8364-391e457c7e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:55.069579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 72/139] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:39:55.099455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884baae9-b728-4044-ab84-5d3b9c2435b9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:55.233534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884baae9-b728-4044-ab84-5d3b9c2435b9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:55.275274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535f7d-8364-4764-bbb0-a95e2fea109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:55.276111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535f7d-8364-4764-bbb0-a95e2fea109c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:55.276397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535f7d-8364-4764-bbb0-a95e2fea109c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:55.276673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535f7d-8364-4764-bbb0-a95e2fea109c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:55.277855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0535f7d-8364-4764-bbb0-a95e2fea109c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:55.279319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0535f7d-8364-4764-bbb0-a95e2fea109c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:55.281340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 68/140] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:39:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:55.286901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dcdfb-f8db-47fd-8364-391e457c7e98 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:55.288935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f0a2-5bc6-4042-a95c-386bc6bb43c1 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:55.289223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f0a2-5bc6-4042-a95c-386bc6bb43c1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:55.289500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f0a2-5bc6-4042-a95c-386bc6bb43c1 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:55.291066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 69/141] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:55.296154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79ec87-1d92-476c-8f05-df87be9fef96 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:55.296555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79ec87-1d92-476c-8f05-df87be9fef96 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:55.297005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79ec87-1d92-476c-8f05-df87be9fef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:55.320978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cf79ec87-1d92-476c-8f05-df87be9fef96 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:55.322173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cf79ec87-1d92-476c-8f05-df87be9fef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:55.408761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 70/142] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:55.442395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79ec87-1d92-476c-8f05-df87be9fef96 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:55.492835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dcdfb-f8db-47fd-8364-391e457c7e98 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:55.589222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79ec87-1d92-476c-8f05-df87be9fef96 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:55.597132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:55.597822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:55.598107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:55.598382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:55.599107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:55.600931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:55.624125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:55.624968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:55.625256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:55.625554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:55.641364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:55.646660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 73/143] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:39:55 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:55.653273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:55.654212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:55.655012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 71/144] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:55.665004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:55.813005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75b5a-a2ac-4a0d-bd58-88363d389cab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:55.862443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:55.863144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:55.863428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:55.863704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:55.864511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:55.864819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:55.866293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:55.878906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 74/145] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:55.885123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:56.031831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac8f4d-4f7b-4faf-81fb-cd421b5205da None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:56.074964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9bcfe-7529-4ca2-b0c4-f7798606b440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:56.076260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9bcfe-7529-4ca2-b0c4-f7798606b440 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.076741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9bcfe-7529-4ca2-b0c4-f7798606b440 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.077237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9bcfe-7529-4ca2-b0c4-f7798606b440 None admin] PATH_INFO: `/v3/users/214c0078b2d6447084e245af3dabb827` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.084670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9bcfe-7529-4ca2-b0c4-f7798606b440 None admin] RBAC: Authorizing `identity:get_user(user_id=214c0078b2d6447084e245af3dabb827)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:56.086418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9bcfe-7529-4ca2-b0c4-f7798606b440 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:56.088368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 72/146] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:55 2022] GET /identity/v3/users/214c0078b2d6447084e245af3dabb827 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:56.094171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:56.162445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b40b-c359-422c-840c-248c9c202af8 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.162997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b40b-c359-422c-840c-248c9c202af8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.163357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b40b-c359-422c-840c-248c9c202af8 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.164973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 73/147] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:56.171001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ac625-2bfc-4b62-9c18-9e6c89935127 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.171293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ac625-2bfc-4b62-9c18-9e6c89935127 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.171736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ac625-2bfc-4b62-9c18-9e6c89935127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.193679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-587ac625-2bfc-4b62-9c18-9e6c89935127 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:56.195203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-587ac625-2bfc-4b62-9c18-9e6c89935127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:56.251462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba9767-b989-458a-88d4-20b525034c95 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:56.267012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 74/148] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:56.312961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:56.313391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ac625-2bfc-4b62-9c18-9e6c89935127 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:56.313850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.314135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.314412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.315623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:56.318838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:56.319103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 75/149] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:56 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:56.325362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:56.484407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ac625-2bfc-4b62-9c18-9e6c89935127 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:56.538488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe85cf-b5ab-434f-8ad3-d653a7fcb75a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:56.556672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:56.557504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.557792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.558071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.580788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:56.588623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:56.589489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:56.590246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:56.594360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee423d-0223-4f97-8a06-9a0e16198717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:56.594808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 75/150] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:56.595774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee423d-0223-4f97-8a06-9a0e16198717 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.596267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee423d-0223-4f97-8a06-9a0e16198717 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.596722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee423d-0223-4f97-8a06-9a0e16198717 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f/users/214c0078b2d6447084e245af3dabb827/roles/fddd0c1720504ccb8fe2783b65becad0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.600242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee423d-0223-4f97-8a06-9a0e16198717 None admin] RBAC: Authorizing `identity:create_grant(project_id=41cd21a482424d49974c940f0f74a43f, user_id=214c0078b2d6447084e245af3dabb827, role_id=fddd0c1720504ccb8fe2783b65becad0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:56.601086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:56.602428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee423d-0223-4f97-8a06-9a0e16198717 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:56.619085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 76/151] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:39:56 2022] PUT /identity/v3/projects/41cd21a482424d49974c940f0f74a43f/users/214c0078b2d6447084e245af3dabb827/roles/fddd0c1720504ccb8fe2783b65becad0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:39:56.620870 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377d155-0e57-47d1-8852-aa620eb20142 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.621844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377d155-0e57-47d1-8852-aa620eb20142 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.622381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377d155-0e57-47d1-8852-aa620eb20142 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.624150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 77/152] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:56.630524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88135d3-7d6d-4111-988c-0284d9e394a9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.631098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88135d3-7d6d-4111-988c-0284d9e394a9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.631755 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88135d3-7d6d-4111-988c-0284d9e394a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.654213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b88135d3-7d6d-4111-988c-0284d9e394a9 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:56.655771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b88135d3-7d6d-4111-988c-0284d9e394a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:56.735696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 78/153] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:56.778272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88135d3-7d6d-4111-988c-0284d9e394a9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:56.918114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d886e-d24a-4e52-900e-a5d94238deff None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:56.928781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88135d3-7d6d-4111-988c-0284d9e394a9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:56.997720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:56.998415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:56.998703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:56.998981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:56.999978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:57.000287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:57.001696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:57.016323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:57.017163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:57.017449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:57.017729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:57.019001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 76/154] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:57.024610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:57.048957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:57.057170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:57.058023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:39:57.058774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 79/155] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:39:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:57.064898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:57.142693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efed12-ded3-4507-a1b2-ecbf86ac5701 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:57.177067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:57.178275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:57.178749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:57.179207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:57.180618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:57.182307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:57.184216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 77/156] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:57.190301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:57.252121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cda03-7751-436d-b276-7f751e03ec3b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:57.294630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:57.295310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:57.295595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:57.295888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:57.303821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999109b5-1ddc-45ad-8f11-ed6ced3607c5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:57.304845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:57.305169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:57.306600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:57.316741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 80/157] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:57.320915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:57.347508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:57.348576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:57.349062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:57.349562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:57.423267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:57.425140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:57.427271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6af402-d61f-447b-848b-da99fc51cbad None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:57.461880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:57.462684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:57.462974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:57.463248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:57.464620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:57.466137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:57.468338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 81/158] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:57.478187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:57.624593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 78/159] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:57.630308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:57.678007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c70510-c698-4f8e-9f20-56bc407549ff None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:57.711972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:57.712640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:57.712926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:57.713202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:57.802873 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dcc69-0b37-40e2-bfd6-bae3f7a19ba4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:57.830130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:57.831996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:57.843563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:57.843563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:57.844433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:57.844502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:57.845688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:57.847558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:57.850263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 79/160] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:57.855673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:57.965804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 82/161] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:57.971476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:58.004791 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3034e5-bda4-4a54-9a23-a3de014127da None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:58.042221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae353e9-ae43-4381-95d8-a1604dfaae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:58.043386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae353e9-ae43-4381-95d8-a1604dfaae02 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.043974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae353e9-ae43-4381-95d8-a1604dfaae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.044447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae353e9-ae43-4381-95d8-a1604dfaae02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.045557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae353e9-ae43-4381-95d8-a1604dfaae02 None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=fd33b2c007f946f2967e45b02ef6025f) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:58.046085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae353e9-ae43-4381-95d8-a1604dfaae02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:58.048566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae353e9-ae43-4381-95d8-a1604dfaae02 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:58.055407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 80/162] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/role_assignments?user.id=fd33b2c007f946f2967e45b02ef6025f&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:58.086674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d514f8-6df2-4496-8a1b-e37f244f9689 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.087353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d514f8-6df2-4496-8a1b-e37f244f9689 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.088266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d514f8-6df2-4496-8a1b-e37f244f9689 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.090902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 81/163] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:39:58.096952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d8d4-c434-401f-9daf-5c34f33f59b0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.097535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d8d4-c434-401f-9daf-5c34f33f59b0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.098163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059d8d4-c434-401f-9daf-5c34f33f59b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.120402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae72ac-09fe-4fce-b389-91fae109e5c0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:58.127747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c059d8d4-c434-401f-9daf-5c34f33f59b0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:58.129425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c059d8d4-c434-401f-9daf-5c34f33f59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:58.169086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:58.169960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.170242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.170518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.171776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:58.176386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:58.179392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 83/164] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:57 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:58.188152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:58.268019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 82/165] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:39:58.321343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059d8d4-c434-401f-9daf-5c34f33f59b0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:58.391158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5782ab-030a-4f8f-99a4-a8f9f868f5f0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:58.478059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059d8d4-c434-401f-9daf-5c34f33f59b0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:58.497196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:58.497907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.498316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.498429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.499274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] RBAC: Adding query filter params (role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=fd33b2c007f946f2967e45b02ef6025f) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:58.499661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:58.501404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:58.517184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 84/166] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:58 2022] GET /identity/v3/role_assignments?user.id=fd33b2c007f946f2967e45b02ef6025f&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=926ac669ff214536b6ec0876b5669dbc => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:58.529950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:58.531289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.532115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.532554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.557785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:58.566201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:58.567308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:39:58.568220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:58.570272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 83/167] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:58.576239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:58.717600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03e1af-761a-47b0-9e19-510af0667cdd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:58.753012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:58.753703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.753986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.754259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.755013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:58.755320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:58.756751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:58.765782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 85/168] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:58.771318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:58.931365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090291-3e6d-435c-8858-04dc0130dd35 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:58.966636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfa0e6-a5d6-433e-bb6c-853d04d4fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:58.967524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa0e6-a5d6-433e-bb6c-853d04d4fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:58.967806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa0e6-a5d6-433e-bb6c-853d04d4fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:58.968106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa0e6-a5d6-433e-bb6c-853d04d4fbc0 None admin] PATH_INFO: `/v3/users/3521504b5b0e494782ca07b80f916dd3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:58.969366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfa0e6-a5d6-433e-bb6c-853d04d4fbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=3521504b5b0e494782ca07b80f916dd3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:58.970819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfa0e6-a5d6-433e-bb6c-853d04d4fbc0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:58.975979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 84/169] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:58 2022] GET /identity/v3/users/3521504b5b0e494782ca07b80f916dd3 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:58.978711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:59.018062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd373c-d60c-4f59-bcc3-18a0d304141d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.018358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd373c-d60c-4f59-bcc3-18a0d304141d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.018621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd373c-d60c-4f59-bcc3-18a0d304141d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.023733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 85/170] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:39:59.038136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626115-4a69-4159-8b07-08f7b4ae229b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.038479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626115-4a69-4159-8b07-08f7b4ae229b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.038720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626115-4a69-4159-8b07-08f7b4ae229b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.068890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-54626115-4a69-4159-8b07-08f7b4ae229b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:39:59.070424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-54626115-4a69-4159-8b07-08f7b4ae229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:39:59.092725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6b8d-193a-4f3a-b734-484c27555d15 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:59.135319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:59.136012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.136295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.136567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.154471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 86/171] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:39:59.205868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626115-4a69-4159-8b07-08f7b4ae229b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:59.265415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:59.266917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:59.327648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626115-4a69-4159-8b07-08f7b4ae229b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:59.376595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:59.377805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.378279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.378741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.393060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:39:59.405429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:39:59.406468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:39:59.407384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:39:59.409805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 87/172] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:39:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:39:59.415203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 86/173] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:39:59.416611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:59.440235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:59.571892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af58f0-fe34-4678-8768-c9bb68cae227 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:59.592435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dd9c4-9b6b-44a7-9f6c-94c40dfd6cfa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:59.618878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:59.619935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.620413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.620899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.621910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:59.622426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:59.624071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:59.633402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 88/174] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:39:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:59.638725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:59.638725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.638725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.638725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.639427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:59.640516 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:59.641000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:59.642720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 87/175] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:39:59 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:59.651890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:39:59.792282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716447d-c951-428a-90b5-24967c210b85 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:59.818665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a8db7-bea7-431e-a5a3-407db4e81aa8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:39:59.834285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:59.835328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.835991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.837766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.838812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=3521504b5b0e494782ca07b80f916dd3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:39:59.840124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:59.842333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:59.857304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 88/176] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:39:59 2022] GET /identity/v3/role_assignments?user.id=3521504b5b0e494782ca07b80f916dd3&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:39:59.879059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:39:59.880387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:39:59.880894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:39:59.881437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] PATH_INFO: `/v3/users/fd33b2c007f946f2967e45b02ef6025f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:39:59.888788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] RBAC: Authorizing `identity:get_user(user_id=fd33b2c007f946f2967e45b02ef6025f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:39:59.890748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:39:59.892874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 89/177] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:39:59 2022] GET /identity/v3/users/fd33b2c007f946f2967e45b02ef6025f => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:39:59.898528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:00.006896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55299a18-d2a7-45a4-a799-d636f3e6962a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:00.047478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02043e6-3783-42e7-9708-c5a54bf9e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:00.048082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02043e6-3783-42e7-9708-c5a54bf9e7db None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.048368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02043e6-3783-42e7-9708-c5a54bf9e7db None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.048640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02043e6-3783-42e7-9708-c5a54bf9e7db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.131675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02043e6-3783-42e7-9708-c5a54bf9e7db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:00.133188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02043e6-3783-42e7-9708-c5a54bf9e7db None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:00.242251 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 89/178] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:00.253082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:00.373873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372215f-4443-42a4-a2d6-5d4baf9a755a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.374166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372215f-4443-42a4-a2d6-5d4baf9a755a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.374345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372215f-4443-42a4-a2d6-5d4baf9a755a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.376746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 90/179] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:00.382777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c8d2-6442-4a9a-aa8a-277734514cc4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.382777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c8d2-6442-4a9a-aa8a-277734514cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.383001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c8d2-6442-4a9a-aa8a-277734514cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.400970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b82aa1-229b-4d5d-b104-c8df8518f998 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:00.416211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d828c8d2-6442-4a9a-aa8a-277734514cc4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:00.417419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d828c8d2-6442-4a9a-aa8a-277734514cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:00.448339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:00.449674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.450152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.450991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] PATH_INFO: `/v3/projects/afa6a2d966254b22978fce772702714c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.456359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=afa6a2d966254b22978fce772702714c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:00.458224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:00.460250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 90/180] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:00 2022] GET /identity/v3/projects/afa6a2d966254b22978fce772702714c => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:00.466042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:00.559486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 91/181] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:00.560939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a63182-e608-4a68-ad62-cbc5c8a44ca0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.561225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a63182-e608-4a68-ad62-cbc5c8a44ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.561500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a63182-e608-4a68-ad62-cbc5c8a44ca0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.563385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 92/182] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:00.568579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20e89d-cf29-42ee-8a7f-d88613d3dd58 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.568867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20e89d-cf29-42ee-8a7f-d88613d3dd58 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.569146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20e89d-cf29-42ee-8a7f-d88613d3dd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.586676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6a20e89d-cf29-42ee-8a7f-d88613d3dd58 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:00.587859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6a20e89d-cf29-42ee-8a7f-d88613d3dd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:00.588824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b077-58e7-4379-898e-d8e278479aa9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:00.635486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:00.636809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.637720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.638219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.639540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=afa6a2d966254b22978fce772702714c, user.id=fd33b2c007f946f2967e45b02ef6025f) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:00.640311 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:00.642381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:00.651136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 91/183] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:00 2022] GET /identity/v3/role_assignments?user.id=fd33b2c007f946f2967e45b02ef6025f&scope.project.id=afa6a2d966254b22978fce772702714c&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:00.652832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:00.671130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 93/184] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:00.706953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20e89d-cf29-42ee-8a7f-d88613d3dd58 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:00.764711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac8dd-6b6d-40be-b5f3-d7062633a77c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:00.807648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:00.808809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.809476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.809972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.824473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:00.833857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:00.834799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:00.835580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:00.838511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 92/185] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:00.844055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:00.877106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20e89d-cf29-42ee-8a7f-d88613d3dd58 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:00.920156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d71a0d-eb56-4080-9f0b-8a9f21141c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:00.921444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71a0d-eb56-4080-9f0b-8a9f21141c67 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.922966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71a0d-eb56-4080-9f0b-8a9f21141c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.923761 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71a0d-eb56-4080-9f0b-8a9f21141c67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.944623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d71a0d-eb56-4080-9f0b-8a9f21141c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-69d71a0d-eb56-4080-9f0b-8a9f21141c67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:00.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:00.954266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:00.955046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 94/186] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:00.956180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afa88-942d-43a9-9002-8c1949194641 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:00.956295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afa88-942d-43a9-9002-8c1949194641 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:00.957459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494afa88-942d-43a9-9002-8c1949194641 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:00.958250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 95/187] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:00.962602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afa88-942d-43a9-9002-8c1949194641 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:00.977196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8d825-b50c-4efa-b989-f1dea627e3d2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.014253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0d6c5-04fb-40b5-89a6-3270cb60fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.014954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0d6c5-04fb-40b5-89a6-3270cb60fc62 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.015334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0d6c5-04fb-40b5-89a6-3270cb60fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.015612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0d6c5-04fb-40b5-89a6-3270cb60fc62 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.016429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0d6c5-04fb-40b5-89a6-3270cb60fc62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:01.016997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0d6c5-04fb-40b5-89a6-3270cb60fc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.019279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0d6c5-04fb-40b5-89a6-3270cb60fc62 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.028156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 93/188] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:01.029492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af0b89-9726-410a-b6f4-a9ea5bac8ca6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.029780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af0b89-9726-410a-b6f4-a9ea5bac8ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.030061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af0b89-9726-410a-b6f4-a9ea5bac8ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.050896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-28af0b89-9726-410a-b6f4-a9ea5bac8ca6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:01.054463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-28af0b89-9726-410a-b6f4-a9ea5bac8ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:01.080662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494afa88-942d-43a9-9002-8c1949194641 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.116001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9480c4-9da3-49ca-a5f0-5c87e62f690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.116610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 94/189] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:01.116737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9480c4-9da3-49ca-a5f0-5c87e62f690c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.116890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9480c4-9da3-49ca-a5f0-5c87e62f690c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.117188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9480c4-9da3-49ca-a5f0-5c87e62f690c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.117905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9480c4-9da3-49ca-a5f0-5c87e62f690c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:01.118202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af0b89-9726-410a-b6f4-a9ea5bac8ca6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.118316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9480c4-9da3-49ca-a5f0-5c87e62f690c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.119607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9480c4-9da3-49ca-a5f0-5c87e62f690c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.129059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 96/190] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:01.130619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c243f-9be7-4837-a466-4c5107a591ee None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.131127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c243f-9be7-4837-a466-4c5107a591ee None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.131604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c243f-9be7-4837-a466-4c5107a591ee None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.133527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 97/191] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:01.134957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c243f-9be7-4837-a466-4c5107a591ee None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.220309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af0b89-9726-410a-b6f4-a9ea5bac8ca6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.235132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c243f-9be7-4837-a466-4c5107a591ee None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.253524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66710b8e-3fcb-4782-a83f-34c7a284b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.254407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710b8e-3fcb-4782-a83f-34c7a284b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.254682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710b8e-3fcb-4782-a83f-34c7a284b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.254971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710b8e-3fcb-4782-a83f-34c7a284b6c2 None admin] PATH_INFO: `/v3/users/214c0078b2d6447084e245af3dabb827` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.256243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66710b8e-3fcb-4782-a83f-34c7a284b6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=214c0078b2d6447084e245af3dabb827)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.257680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66710b8e-3fcb-4782-a83f-34c7a284b6c2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.263704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 95/192] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/users/214c0078b2d6447084e245af3dabb827 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:01.263704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9213077-dbb2-47b4-8ba8-baf10bd63a0d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.263704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9213077-dbb2-47b4-8ba8-baf10bd63a0d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.263704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9213077-dbb2-47b4-8ba8-baf10bd63a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.268988 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.269871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.270150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.270424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] PATH_INFO: `/v3/users/66029997063a4778890acb7c946c18c1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.276679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d9213077-dbb2-47b4-8ba8-baf10bd63a0d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:01.277848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d9213077-dbb2-47b4-8ba8-baf10bd63a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:01.284014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] RBAC: Authorizing `identity:get_user(user_id=66029997063a4778890acb7c946c18c1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.285481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.287136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 98/193] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/users/66029997063a4778890acb7c946c18c1 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:01.287960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.344560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 96/194] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:01.345414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9213077-dbb2-47b4-8ba8-baf10bd63a0d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.388518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8228ea-36da-41d8-a6f7-cb8f323b0b2d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.421296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.422580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.422852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.423125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.433038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:01.439960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9213077-dbb2-47b4-8ba8-baf10bd63a0d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:01.442424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:01.443339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:01.444184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 99/195] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:01.444840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.481766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.482346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.482641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.482913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.545812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2539c-308e-4e05-8ee1-c801d70725c8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.547077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.548639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.577558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.578233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.578511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.578785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.641293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.642632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 97/196] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:01.642731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.643467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.737015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512a5f-155a-4ad4-8dc7-d7247f936779 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.746551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 100/197] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:01.748276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.776766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.777576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.777859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.778175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.779378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.780883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.782518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 98/198] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:01.783286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.852929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fa502-01c0-4592-998e-e1cef8a145fc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.885466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a74d3-1c5f-414a-b9f8-2875eacbc2a2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:01.892091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.892766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.893049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.893323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.894068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:01.894363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.895749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.903707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 101/199] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:01.904506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:01.918379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:01.919244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:01.919518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:01.919786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:01.920997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:01.922569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:01.924284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 99/200] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:01.925008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:02.002803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156f42b-a35e-488f-a3a2-12d516e80f0d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.018673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c7e89-5b16-4f47-b086-b9d622f36d5a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.036213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.037079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.037360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.037635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.038821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.040332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.042049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 102/201] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:01 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:02.042871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:02.052697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.053379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.053661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.053937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.054653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.056130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.083608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 100/202] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:01 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:02.096145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:02.146750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b2ae-6eed-41c2-a2e9-a2681e028693 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.189312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.190211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.190492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.190767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] PATH_INFO: `/v3/users/66029997063a4778890acb7c946c18c1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.192098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] RBAC: Authorizing `identity:get_user(user_id=66029997063a4778890acb7c946c18c1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.193662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.195415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 103/203] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:02 2022] GET /identity/v3/users/66029997063a4778890acb7c946c18c1 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:02.196302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:02.201031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a435-1863-4e3d-8de0-a23122528baf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.238057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.238730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.239117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.239359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.240234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] RBAC: Adding query filter params (role.id=fddd0c1720504ccb8fe2783b65becad0, scope.project.id=41cd21a482424d49974c940f0f74a43f, user.id=214c0078b2d6447084e245af3dabb827) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:02.240544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.242037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.255988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 101/204] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:02 2022] GET /identity/v3/role_assignments?user.id=214c0078b2d6447084e245af3dabb827&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=fddd0c1720504ccb8fe2783b65becad0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:02.255988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:02.332002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe70a5-e185-4df8-8a26-c44b993974b7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.377037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.377736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.378015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.378285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.379217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=66029997063a4778890acb7c946c18c1) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:02.379433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.381777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.386901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0859f-6be4-4f63-8ee5-cd89caa785fa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.387745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 104/205] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:02 2022] GET /identity/v3/role_assignments?user.id=66029997063a4778890acb7c946c18c1&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:02.429489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.430569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.431126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.431602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.518700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.520231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.629552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 102/206] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:02.635526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:02.736339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49369b63-5f46-4685-ad6e-b51611e5922b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.770661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da3c18-a269-4e22-baef-83f73bb51091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.771456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3c18-a269-4e22-baef-83f73bb51091 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.771733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3c18-a269-4e22-baef-83f73bb51091 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.772040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3c18-a269-4e22-baef-83f73bb51091 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.773215 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da3c18-a269-4e22-baef-83f73bb51091 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.774672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da3c18-a269-4e22-baef-83f73bb51091 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.776787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 105/207] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:02 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:02.782633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:02.883356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f57426-b574-4d21-b594-53b65823f4aa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:02.918291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fc7ca-3175-490e-84e1-5103be6539c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:02.919310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc7ca-3175-490e-84e1-5103be6539c3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:02.919817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc7ca-3175-490e-84e1-5103be6539c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:02.920310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc7ca-3175-490e-84e1-5103be6539c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:02.921398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc7ca-3175-490e-84e1-5103be6539c3 None admin] RBAC: Adding query filter params (role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=66029997063a4778890acb7c946c18c1) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:02.921915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc7ca-3175-490e-84e1-5103be6539c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:02.923561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc7ca-3175-490e-84e1-5103be6539c3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:02.930075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 103/208] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:02 2022] GET /identity/v3/role_assignments?user.id=66029997063a4778890acb7c946c18c1&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=926ac669ff214536b6ec0876b5669dbc => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:04.628969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f5ef4-f27d-4353-8fc2-27fd980d21b0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.629489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f5ef4-f27d-4353-8fc2-27fd980d21b0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.629489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f5ef4-f27d-4353-8fc2-27fd980d21b0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.630532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aedaa-17c7-416f-84f5-76bc4b877f82 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.630900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 106/209] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:04.631437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aedaa-17c7-416f-84f5-76bc4b877f82 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.631981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aedaa-17c7-416f-84f5-76bc4b877f82 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.633563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 104/210] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:04.636209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491a788-b4df-49f1-8c50-f2c0288e6b49 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.636500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491a788-b4df-49f1-8c50-f2c0288e6b49 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.636779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491a788-b4df-49f1-8c50-f2c0288e6b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.638587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477e18-7385-447f-b11b-bd2fb76e2144 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.639183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477e18-7385-447f-b11b-bd2fb76e2144 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.639753 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477e18-7385-447f-b11b-bd2fb76e2144 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.641772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 105/211] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:04.642802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f86e3b-77fb-4ba7-a233-6f58014b09bc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.643362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f86e3b-77fb-4ba7-a233-6f58014b09bc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.643834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f86e3b-77fb-4ba7-a233-6f58014b09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.653977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f491a788-b4df-49f1-8c50-f2c0288e6b49 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:04.655185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f491a788-b4df-49f1-8c50-f2c0288e6b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:04.660401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-00f86e3b-77fb-4ba7-a233-6f58014b09bc None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:04.661567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-00f86e3b-77fb-4ba7-a233-6f58014b09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:04.721859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 107/212] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:04.723481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db0d0-bc64-457a-8623-942aed49b4b4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.723770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db0d0-bc64-457a-8623-942aed49b4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.724089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db0d0-bc64-457a-8623-942aed49b4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.737340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 106/213] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:04.741586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-df2db0d0-bc64-457a-8623-942aed49b4b4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:04.742993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df2db0d0-bc64-457a-8623-942aed49b4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:04.748710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f86e3b-77fb-4ba7-a233-6f58014b09bc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:04.812815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 108/214] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:04.813977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db0d0-bc64-457a-8623-942aed49b4b4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:04.854112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f86e3b-77fb-4ba7-a233-6f58014b09bc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:04.887616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:04.888447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.888727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.888992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.890230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:04.891686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:04.893341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 107/215] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:04.894088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:04.913579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db0d0-bc64-457a-8623-942aed49b4b4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:04.950584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:04.951533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:04.951815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:04.952122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:04.963693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:04.971606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:04.972592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:04.973368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 109/216] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:04.974645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:04.998830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fbcfa-9dbe-4202-a41f-d4396677d4e2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.031650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.032489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.032763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.033041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.043571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:05.051538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:05.052717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:05.053697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 108/217] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:05.054401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.073238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c75a-0ac6-42c5-8f08-f353c4f84823 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.107145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.107818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.108126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.108400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.109154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.110635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.132979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 110/218] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:04 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:05.133805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.157054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369d1e3-e026-4e4f-9343-4bc7213b885c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.193141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1adba9-b79b-4e5d-9f75-8064143d19d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.193904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adba9-b79b-4e5d-9f75-8064143d19d4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.194190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adba9-b79b-4e5d-9f75-8064143d19d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.194504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adba9-b79b-4e5d-9f75-8064143d19d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.195280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1adba9-b79b-4e5d-9f75-8064143d19d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:05.195592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1adba9-b79b-4e5d-9f75-8064143d19d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.197067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1adba9-b79b-4e5d-9f75-8064143d19d4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.206251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 109/219] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:05.207613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353becd-e987-48c7-8c9e-e4b9d2662ebf None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.207931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353becd-e987-48c7-8c9e-e4b9d2662ebf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.208217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353becd-e987-48c7-8c9e-e4b9d2662ebf None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.209453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 110/220] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:05.214903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353becd-e987-48c7-8c9e-e4b9d2662ebf None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.241879 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1a42-a943-48ef-9d3e-ad2229f03279 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.276289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9c12-a5bc-46d4-9049-d6ea87eb2ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.276987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9c12-a5bc-46d4-9049-d6ea87eb2ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.277268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9c12-a5bc-46d4-9049-d6ea87eb2ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.277546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9c12-a5bc-46d4-9049-d6ea87eb2ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.278315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9c12-a5bc-46d4-9049-d6ea87eb2ee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:05.278604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9c12-a5bc-46d4-9049-d6ea87eb2ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.280067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9c12-a5bc-46d4-9049-d6ea87eb2ee5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.288812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 111/221] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:05.290093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37eb8f-85d8-407d-8bfe-304b5ffcada2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.290381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37eb8f-85d8-407d-8bfe-304b5ffcada2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.290656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37eb8f-85d8-407d-8bfe-304b5ffcada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.309699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5e37eb8f-85d8-407d-8bfe-304b5ffcada2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:05.311033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5e37eb8f-85d8-407d-8bfe-304b5ffcada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:05.331212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353becd-e987-48c7-8c9e-e4b9d2662ebf None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.367850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.368927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.369250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.369591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] PATH_INFO: `/v3/users/0245c54c4d0a4cdaab090ebb5a378c02` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.381703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 112/222] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:05.382337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37eb8f-85d8-407d-8bfe-304b5ffcada2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.385951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=0245c54c4d0a4cdaab090ebb5a378c02)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.387323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.389372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 111/223] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/users/0245c54c4d0a4cdaab090ebb5a378c02 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:05.395353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.485241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37eb8f-85d8-407d-8bfe-304b5ffcada2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.507126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f50ac-f561-4c78-908d-41288043b2b7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.523991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.525099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.525515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.525947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] PATH_INFO: `/v3/users/66029997063a4778890acb7c946c18c1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.527131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] RBAC: Authorizing `identity:get_user(user_id=66029997063a4778890acb7c946c18c1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.528951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.530243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 113/224] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/users/66029997063a4778890acb7c946c18c1 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:05.531130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.545598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.546721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.547246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.547742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.617012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.618805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.627678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a271732-df8c-45ce-9373-a0b324549e3a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.660627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.661444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.661730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.661997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.672672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:05.680754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:05.681672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:05.682478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 114/225] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:05.683135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.726341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 112/226] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:40:05.728032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.781043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c387d8-9100-4265-b7e1-1140a99f046f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.831849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915ab6-471a-42f5-9b9b-7bae6f30a11a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.832904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.833787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.834070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.834344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.836571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.838050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.840091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 115/227] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:05.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.869111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:05.870163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:05.870639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:05.871133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:05.872141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:05.872646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:05.874308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:05.883162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 113/228] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:05.884423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:05.958908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9f5c-ba93-4b8a-8c9b-a97303ca5d6b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:05.991061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2c335-3b88-4191-8d4b-796c21b70d23 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:06.003792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:06.004687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:06.004992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:06.005391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:06.006951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:06.008693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:06.011033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 116/229] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:05 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:06.011625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:06.034459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:06.035732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:06.036278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:06.036748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689/users/66029997063a4778890acb7c946c18c1/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:06.039077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] RBAC: Authorizing `identity:create_grant(project_id=740d00875c1549f9978dbba7e8d50689, user_id=66029997063a4778890acb7c946c18c1, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:06.040900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:06.057363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 114/230] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:05 2022] PUT /identity/v3/projects/740d00875c1549f9978dbba7e8d50689/users/66029997063a4778890acb7c946c18c1/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:06.058779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:06.151027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cccf3-92ad-4d7c-bfea-532b69a3467f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:06.204288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:06.206456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:06.206456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:06.206456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] PATH_INFO: `/v3/users/66029997063a4778890acb7c946c18c1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:06.207723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] RBAC: Authorizing `identity:get_user(user_id=66029997063a4778890acb7c946c18c1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:06.209345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:06.211632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 117/231] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:06 2022] GET /identity/v3/users/66029997063a4778890acb7c946c18c1 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:06.217738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:06.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcae005-33e4-47ae-9cab-e3058dc81e31 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:06.313699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:06.314368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:06.314650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:06.314923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:06.315766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=0245c54c4d0a4cdaab090ebb5a378c02) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:06.316116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:06.317564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:06.323268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 115/232] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:06 2022] GET /identity/v3/role_assignments?user.id=0245c54c4d0a4cdaab090ebb5a378c02&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:06.340885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca923803-1636-45f7-8a5c-a28f67cacff4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:06.378697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aed6f-b1b8-4f3e-bf60-c3e05d27bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:06.379754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aed6f-b1b8-4f3e-bf60-c3e05d27bf9b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:06.380157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aed6f-b1b8-4f3e-bf60-c3e05d27bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:06.380530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aed6f-b1b8-4f3e-bf60-c3e05d27bf9b None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:06.381891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aed6f-b1b8-4f3e-bf60-c3e05d27bf9b None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:06.383486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aed6f-b1b8-4f3e-bf60-c3e05d27bf9b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:06.385479 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 118/233] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:06 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:06.391925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:06.557995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7463312-921c-497f-9331-59bfcbef47ca None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:06.597169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7518ae4-d0f2-45a7-a4af-e5834988ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:06.598079 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7518ae4-d0f2-45a7-a4af-e5834988ec7b None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:06.598363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7518ae4-d0f2-45a7-a4af-e5834988ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:06.598639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7518ae4-d0f2-45a7-a4af-e5834988ec7b None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689/users/66029997063a4778890acb7c946c18c1/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:06.601265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7518ae4-d0f2-45a7-a4af-e5834988ec7b None admin] RBAC: Authorizing `identity:create_grant(project_id=740d00875c1549f9978dbba7e8d50689, user_id=66029997063a4778890acb7c946c18c1, role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:06.603013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7518ae4-d0f2-45a7-a4af-e5834988ec7b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:06.620095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 116/234] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:06 2022] PUT /identity/v3/projects/740d00875c1549f9978dbba7e8d50689/users/66029997063a4778890acb7c946c18c1/roles/926ac669ff214536b6ec0876b5669dbc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:40:07.678782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a23b-f503-471a-a220-902ed8c0c948 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:07.679295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a23b-f503-471a-a220-902ed8c0c948 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:07.679369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a23b-f503-471a-a220-902ed8c0c948 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:07.680716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 119/235] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:07.686208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383dd95-3e27-4f75-ae82-71a1636b9d0f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:07.686917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383dd95-3e27-4f75-ae82-71a1636b9d0f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:07.686917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383dd95-3e27-4f75-ae82-71a1636b9d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:07.712870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8383dd95-3e27-4f75-ae82-71a1636b9d0f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:07.714068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8383dd95-3e27-4f75-ae82-71a1636b9d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:07.788333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 117/236] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:07.810788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4a23b-f503-471a-a220-902ed8c0c948 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:07.921492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4a23b-f503-471a-a220-902ed8c0c948 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:07.957919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:07.958742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:07.959022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:07.959309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:07.971068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:07.979096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:07.980058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:07.980860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 120/237] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:07.986167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383dd95-3e27-4f75-ae82-71a1636b9d0f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:08.082237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383dd95-3e27-4f75-ae82-71a1636b9d0f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:08.117509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d08b96-d6c5-41ba-a1f8-9c533db9a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:08.118187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d08b96-d6c5-41ba-a1f8-9c533db9a27c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.118471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d08b96-d6c5-41ba-a1f8-9c533db9a27c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.118744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d08b96-d6c5-41ba-a1f8-9c533db9a27c None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.119495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d08b96-d6c5-41ba-a1f8-9c533db9a27c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:08.119802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d08b96-d6c5-41ba-a1f8-9c533db9a27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:08.121231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d08b96-d6c5-41ba-a1f8-9c533db9a27c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:08.129749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 118/238] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:08.135281 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:08.173034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0ce28-b9b6-4681-a01c-7408c43287a7 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.173367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0ce28-b9b6-4681-a01c-7408c43287a7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.173585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0ce28-b9b6-4681-a01c-7408c43287a7 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.174967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 119/239] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:08.180775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7bdd5-701a-40ce-b5f0-bb377d5105ed None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.181065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7bdd5-701a-40ce-b5f0-bb377d5105ed None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.181344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7bdd5-701a-40ce-b5f0-bb377d5105ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.200865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f8e7bdd5-701a-40ce-b5f0-bb377d5105ed None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:08.202049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8e7bdd5-701a-40ce-b5f0-bb377d5105ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:08.278086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 120/240] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:08.305201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7bdd5-701a-40ce-b5f0-bb377d5105ed None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:08.312125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ca7fc-20c2-45fb-8baf-fbe3c1cc6b23 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:08.360946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:08.362171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.362646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.363111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] PATH_INFO: `/v3/users/dd1dfc0292244470bcbefd7aed418c2b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.377520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] RBAC: Authorizing `identity:get_user(user_id=dd1dfc0292244470bcbefd7aed418c2b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:08.379326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:08.381325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 121/241] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:08 2022] GET /identity/v3/users/dd1dfc0292244470bcbefd7aed418c2b => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:08.392919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:08.407076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7bdd5-701a-40ce-b5f0-bb377d5105ed None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:08.447895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:08.447895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.447895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.447895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.448293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:08.448293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:08.448293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 121/242] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:08.451677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:08.584947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ee636-fca8-46a5-bbfc-03d7c29c794f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:08.595249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5192e7-33ef-4a49-b074-d0d261c08f34 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:08.649243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1815-a424-4311-89ed-6292f1dbb257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:08.649846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1815-a424-4311-89ed-6292f1dbb257 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.650128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1815-a424-4311-89ed-6292f1dbb257 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.650410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1815-a424-4311-89ed-6292f1dbb257 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.651126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1815-a424-4311-89ed-6292f1dbb257 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:08.652601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1815-a424-4311-89ed-6292f1dbb257 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:08.657609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:08.658497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.658985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.659447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.676097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 122/243] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:08 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:40:08.726898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626cb6f-41dd-46ec-8a43-c1326cdd57fd None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.727506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626cb6f-41dd-46ec-8a43-c1326cdd57fd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.727506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626cb6f-41dd-46ec-8a43-c1326cdd57fd None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.729080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 123/244] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:08.735647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab18db7-ca94-4642-8669-d0039c7f0a41 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:08.735970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab18db7-ca94-4642-8669-d0039c7f0a41 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:08.736252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab18db7-ca94-4642-8669-d0039c7f0a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:08.760137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:08.761653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:08.781153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8ab18db7-ca94-4642-8669-d0039c7f0a41 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:08.782372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8ab18db7-ca94-4642-8669-d0039c7f0a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:08.865708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 122/245] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:08.871165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:08.951210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 124/246] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:09.006411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab18db7-ca94-4642-8669-d0039c7f0a41 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:09.010653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d4a86-98fe-4e84-a63c-35fd33611108 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:09.058465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:09.059377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.059609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.059887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.061102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:09.062812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:09.066307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 123/247] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:08 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:09.076905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:09.125446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab18db7-ca94-4642-8669-d0039c7f0a41 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:09.165051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad1981-a3d3-47d5-bd5f-da6328316972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:09.165863 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad1981-a3d3-47d5-bd5f-da6328316972 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.166147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad1981-a3d3-47d5-bd5f-da6328316972 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.166422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad1981-a3d3-47d5-bd5f-da6328316972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.182414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad1981-a3d3-47d5-bd5f-da6328316972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-43ad1981-a3d3-47d5-bd5f-da6328316972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:09.190467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:09.191359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:09.192618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 125/248] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:09.197194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e42ed-7a15-4eed-89b7-eb308c8147ec None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.197489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e42ed-7a15-4eed-89b7-eb308c8147ec None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.197768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e42ed-7a15-4eed-89b7-eb308c8147ec None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.199060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 126/249] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:09.200699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e42ed-7a15-4eed-89b7-eb308c8147ec None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:09.201147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4349e2d-6514-455f-b706-dd2e6b242c54 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:09.239984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ee412-f3a8-4062-9052-c9f39cafc627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:09.240650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee412-f3a8-4062-9052-c9f39cafc627 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.240931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee412-f3a8-4062-9052-c9f39cafc627 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.241201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee412-f3a8-4062-9052-c9f39cafc627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.242040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee412-f3a8-4062-9052-c9f39cafc627 None admin] RBAC: Adding query filter params (role.id=fddd0c1720504ccb8fe2783b65becad0, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=dd1dfc0292244470bcbefd7aed418c2b) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:09.242350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee412-f3a8-4062-9052-c9f39cafc627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:09.243813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee412-f3a8-4062-9052-c9f39cafc627 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:09.253802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 124/250] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:09 2022] GET /identity/v3/role_assignments?user.id=dd1dfc0292244470bcbefd7aed418c2b&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=fddd0c1720504ccb8fe2783b65becad0 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:09.256256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200de53-ed72-46ec-a040-0f07a37ac024 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.256750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200de53-ed72-46ec-a040-0f07a37ac024 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.257217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200de53-ed72-46ec-a040-0f07a37ac024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.281078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6200de53-ed72-46ec-a040-0f07a37ac024 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:09.282377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6200de53-ed72-46ec-a040-0f07a37ac024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:09.327853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e42ed-7a15-4eed-89b7-eb308c8147ec None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:09.360748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 125/251] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:09.368453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:09.369615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.370092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.370625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.371717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:09.372259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:09.374136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:09.385335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200de53-ed72-46ec-a040-0f07a37ac024 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:09.386259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 127/252] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:09.393427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:09.561632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200de53-ed72-46ec-a040-0f07a37ac024 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:09.581856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7def2-a963-4878-9ed4-dc910c96e2e7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:09.624887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc3f5-6b54-4f3d-b952-9e99a82979de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:09.625699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc3f5-6b54-4f3d-b952-9e99a82979de None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.625979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc3f5-6b54-4f3d-b952-9e99a82979de None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.626252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc3f5-6b54-4f3d-b952-9e99a82979de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.627338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60154727-208f-4dcb-baa9-215515f140c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:09.628238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154727-208f-4dcb-baa9-215515f140c1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.628513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154727-208f-4dcb-baa9-215515f140c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.628780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154727-208f-4dcb-baa9-215515f140c1 None admin] PATH_INFO: `/v3/users/66029997063a4778890acb7c946c18c1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.630092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60154727-208f-4dcb-baa9-215515f140c1 None admin] RBAC: Authorizing `identity:get_user(user_id=66029997063a4778890acb7c946c18c1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:09.631556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60154727-208f-4dcb-baa9-215515f140c1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:09.633232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 128/253] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:09 2022] GET /identity/v3/users/66029997063a4778890acb7c946c18c1 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:09.634396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9449-d12b-4c4d-a145-0293419c6c92 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.634730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9449-d12b-4c4d-a145-0293419c6c92 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.634957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9449-d12b-4c4d-a145-0293419c6c92 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.636217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 129/254] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:09.644715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa9449-d12b-4c4d-a145-0293419c6c92 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:09.656852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc3f5-6b54-4f3d-b952-9e99a82979de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3e5dc3f5-6b54-4f3d-b952-9e99a82979de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:09.664591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:09.665455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:09.666245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:09.672312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 126/255] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:09.673695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1a6d-f212-4095-8636-90c1e3cc86d5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.673990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1a6d-f212-4095-8636-90c1e3cc86d5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.674274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1a6d-f212-4095-8636-90c1e3cc86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.704292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b80b1a6d-f212-4095-8636-90c1e3cc86d5 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:09.705881 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b80b1a6d-f212-4095-8636-90c1e3cc86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:09.799165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa9449-d12b-4c4d-a145-0293419c6c92 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:09.832223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 127/256] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:09.835189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b1a6d-f212-4095-8636-90c1e3cc86d5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:09.856732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:09.857777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:09.858247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:09.860161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:09.978174 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:09.980040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:10.008666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b1a6d-f212-4095-8636-90c1e3cc86d5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.069946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.070945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.071410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.071919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:10.072855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:10.073354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:10.074933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:10.100363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 128/257] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:10.101719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.160337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 130/258] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:10.162318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.291564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374955d-40c0-4540-bd10-eca31ee0514c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.306747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04560a-1c66-4bc7-a29d-d7eb6a6c5da7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.339487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.340324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.340614 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.340887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] PATH_INFO: `/v3/users/0245c54c4d0a4cdaab090ebb5a378c02` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:10.343222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] RBAC: Authorizing `identity:get_user(user_id=0245c54c4d0a4cdaab090ebb5a378c02)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:10.344802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:10.346446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 131/259] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:10 2022] GET /identity/v3/users/0245c54c4d0a4cdaab090ebb5a378c02 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:10.347200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.359090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.359925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.360209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.360488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:10.381481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:10.389448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:10.390423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 129/260] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:10.391593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.480169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3b88-f84b-4e14-82ec-f280f057af75 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.519845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.520760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.521039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.521312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:10.523648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:10.525148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:10.532080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 132/261] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:10 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:10.532985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.574920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45488d8b-25f4-41df-bb53-72bf63373801 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.612362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.613169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.613452 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.613728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:10.615022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:10.616795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:10.619111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 130/262] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:10 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:10.620020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.727324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75fbc-fdec-46c3-9a18-bfd45e6e5654 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.763535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.764366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.764736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.765064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:10.766069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=66029997063a4778890acb7c946c18c1) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:10.766386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:10.767850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 131/263] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:10 2022] GET /identity/v3/role_assignments?user.id=66029997063a4778890acb7c946c18c1&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:10.775956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.818023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3eb64-3af9-4beb-92a7-30514d1efddf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.892406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.893441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.893943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.894411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:10.896109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:10.896666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:10.898390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:10.908575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 133/264] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:10.915009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:10.954243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d5fb-4379-462f-803d-af751bce1f47 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:10.997469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:10.998605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:10.999110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:10.999517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689/users/0245c54c4d0a4cdaab090ebb5a378c02/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:11.001884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=740d00875c1549f9978dbba7e8d50689, user_id=0245c54c4d0a4cdaab090ebb5a378c02, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:11.003549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:11.019536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 132/265] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:10 2022] PUT /identity/v3/projects/740d00875c1549f9978dbba7e8d50689/users/0245c54c4d0a4cdaab090ebb5a378c02/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:11.039996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9d34-a4d6-44a0-ba07-10090cb747ea None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:11.082004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:11.083157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:11.083576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:11.084014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] PATH_INFO: `/v3/users/66029997063a4778890acb7c946c18c1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:11.085757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] RBAC: Authorizing `identity:get_user(user_id=66029997063a4778890acb7c946c18c1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:11.087478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:11.093857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 134/266] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:10 2022] GET /identity/v3/users/66029997063a4778890acb7c946c18c1 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:11.095240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:11.223328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b3bfe-3466-4d9c-bdfd-72d8aae966b1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:11.259037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:11.259705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:11.260026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:11.260308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:11.336030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:11.337647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:11.454596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 133/267] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:11.460261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:11.582521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990c9c9-4c85-4ed6-acf4-d6e461f22d04 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:11.623372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e2038-8e5e-4f78-9b98-35b62e9bc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:11.624497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e2038-8e5e-4f78-9b98-35b62e9bc546 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:11.624791 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e2038-8e5e-4f78-9b98-35b62e9bc546 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:11.625067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e2038-8e5e-4f78-9b98-35b62e9bc546 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:11.626295 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e2038-8e5e-4f78-9b98-35b62e9bc546 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:11.627741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e2038-8e5e-4f78-9b98-35b62e9bc546 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:11.629785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 135/268] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:11 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:11.635532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:11.816150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5599-5cf2-407f-a97b-f5a2c9198039 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:11.866951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2252-e187-40db-944f-a31fd15a8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:11.867639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2252-e187-40db-944f-a31fd15a8b0e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:11.867957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2252-e187-40db-944f-a31fd15a8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:11.868409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2252-e187-40db-944f-a31fd15a8b0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:11.869256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2252-e187-40db-944f-a31fd15a8b0e None admin] RBAC: Adding query filter params (role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=66029997063a4778890acb7c946c18c1) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:11.869570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2252-e187-40db-944f-a31fd15a8b0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:11.871031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2252-e187-40db-944f-a31fd15a8b0e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:11.881964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 134/269] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:11 2022] GET /identity/v3/role_assignments?user.id=66029997063a4778890acb7c946c18c1&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=926ac669ff214536b6ec0876b5669dbc => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:11.964841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794be8c-98d6-4143-a3d5-e19578c0b3be None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:11.965829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794be8c-98d6-4143-a3d5-e19578c0b3be None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:11.966372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794be8c-98d6-4143-a3d5-e19578c0b3be None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:11.968201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 136/270] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:11.974420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561755-e4ae-4775-a868-f66b41bd21f9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:11.975660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561755-e4ae-4775-a868-f66b41bd21f9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:11.976178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561755-e4ae-4775-a868-f66b41bd21f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:11.994718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a8561755-e4ae-4775-a868-f66b41bd21f9 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:11.996368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a8561755-e4ae-4775-a868-f66b41bd21f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:12.016467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727be9d8-229c-4748-a60a-0ad14035c522 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.017088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727be9d8-229c-4748-a60a-0ad14035c522 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.017555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727be9d8-229c-4748-a60a-0ad14035c522 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.019449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 137/271] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:12.029723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8e5b-7013-4905-aed4-6bb1f87f76da None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.030445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8e5b-7013-4905-aed4-6bb1f87f76da None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.030976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8e5b-7013-4905-aed4-6bb1f87f76da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.054184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5aca8e5b-7013-4905-aed4-6bb1f87f76da None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:12.056436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5aca8e5b-7013-4905-aed4-6bb1f87f76da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:12.114055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 135/272] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:12.115887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63e1f-99b3-4f79-9492-62b368003482 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.117171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63e1f-99b3-4f79-9492-62b368003482 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.123904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63e1f-99b3-4f79-9492-62b368003482 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.125434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 136/273] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:12.133450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36f06-f0f9-4091-bc7a-bcadb8a9a24b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.134025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36f06-f0f9-4091-bc7a-bcadb8a9a24b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.134307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36f06-f0f9-4091-bc7a-bcadb8a9a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.159263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e5a36f06-f0f9-4091-bc7a-bcadb8a9a24b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:12.160498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e5a36f06-f0f9-4091-bc7a-bcadb8a9a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:12.163908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 138/274] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:12.163908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca8e5b-7013-4905-aed4-6bb1f87f76da None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.256065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 137/275] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:12.257808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36f06-f0f9-4091-bc7a-bcadb8a9a24b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.304191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca8e5b-7013-4905-aed4-6bb1f87f76da None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.340416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.341592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.342070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.342512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.344088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:12.345861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:12.347986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 139/276] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:12.348988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.387548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36f06-f0f9-4091-bc7a-bcadb8a9a24b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.428850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.430432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.430714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.430986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.444221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:12.451926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:12.452873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:12.453672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 138/277] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:12.454330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.473210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e97c2-296d-4587-bad3-2c6ec1614e49 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.518784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.519598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.519901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.520172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.535369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:12.544708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:12.545595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:12.546626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 140/278] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:12.552072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.575023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c975a-6a59-489b-a61d-09fe9a745c20 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.611533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.612370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.612917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.613205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.614102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:12.616049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:12.643562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 139/279] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:12 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:12.644892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.680401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650d19-3fe8-4793-afd8-bccfa4ffe033 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.718020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.718457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.718748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.719015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.719789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:12.720123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:12.721561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:12.731521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 141/280] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:12.736741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.761263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a1f8-700b-4b77-82ad-63e93fe50c10 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.798183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.799259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.799738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.800246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.801204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:12.801726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:12.803353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:12.814960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 140/281] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:12.821228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.847026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1ce9-b4d2-405b-9ad6-f74a19c56a06 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.887595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.888584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.888866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.889140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] PATH_INFO: `/v3/users/e8e699e40c4f4fccbf36025f9134db0b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.904373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e8e699e40c4f4fccbf36025f9134db0b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:12.906178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:12.908465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 142/282] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/users/e8e699e40c4f4fccbf36025f9134db0b => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:12.916187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:12.930887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7222-3a8d-480c-b83d-a3e11700c989 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:12.977546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:12.978434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:12.978721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:12.978986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] PATH_INFO: `/v3/users/dd1dfc0292244470bcbefd7aed418c2b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:12.980819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] RBAC: Authorizing `identity:get_user(user_id=dd1dfc0292244470bcbefd7aed418c2b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:12.982278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:12.984533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 141/283] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/users/dd1dfc0292244470bcbefd7aed418c2b => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:12.991848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:13.042341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0b1db-739f-4531-a678-380b2fa606d8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:13.088998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:13.090184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:13.090692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:13.091156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:13.092227 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, user.id=e8e699e40c4f4fccbf36025f9134db0b, scope.system=all) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:13.093123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:13.094781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:13.100883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 143/284] 10.222.0.99 () {56 vars in 1308 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/role_assignments?user.id=e8e699e40c4f4fccbf36025f9134db0b&scope.system=all&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:13.121051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d437916-1cc2-4d34-9ee4-5a19c7659ebd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:13.157873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c7bf8-3761-4fc6-ab65-2aa8ce798583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:13.158670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c7bf8-3761-4fc6-ab65-2aa8ce798583 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:13.158953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c7bf8-3761-4fc6-ab65-2aa8ce798583 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:13.159228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c7bf8-3761-4fc6-ab65-2aa8ce798583 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:13.160563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c7bf8-3761-4fc6-ab65-2aa8ce798583 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:13.162056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c7bf8-3761-4fc6-ab65-2aa8ce798583 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:13.164169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 142/285] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:12 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:13.169867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:13.340605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a9b9-9f94-4e33-8cb8-4dbfa520adba None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:13.388589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836179ec-c4b9-4a15-9fcd-bb399f5cd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:13.389562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836179ec-c4b9-4a15-9fcd-bb399f5cd9b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:13.389895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836179ec-c4b9-4a15-9fcd-bb399f5cd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:13.390163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836179ec-c4b9-4a15-9fcd-bb399f5cd9b2 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689/users/dd1dfc0292244470bcbefd7aed418c2b/roles/fddd0c1720504ccb8fe2783b65becad0` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:13.392233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836179ec-c4b9-4a15-9fcd-bb399f5cd9b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=740d00875c1549f9978dbba7e8d50689, user_id=dd1dfc0292244470bcbefd7aed418c2b, role_id=fddd0c1720504ccb8fe2783b65becad0)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:13.393675 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836179ec-c4b9-4a15-9fcd-bb399f5cd9b2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:13.407661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 144/286] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:13 2022] PUT /identity/v3/projects/740d00875c1549f9978dbba7e8d50689/users/dd1dfc0292244470bcbefd7aed418c2b/roles/fddd0c1720504ccb8fe2783b65becad0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:13.802518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d68f-a695-4b20-b4a0-b1352c6df102 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:13.802706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d68f-a695-4b20-b4a0-b1352c6df102 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:13.802990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d68f-a695-4b20-b4a0-b1352c6df102 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:13.804423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 143/287] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:13.810804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372319-bad9-4bbb-897e-e008bda61ba4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:13.811097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372319-bad9-4bbb-897e-e008bda61ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:13.811541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372319-bad9-4bbb-897e-e008bda61ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:13.834100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-14372319-bad9-4bbb-897e-e008bda61ba4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:13.835396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-14372319-bad9-4bbb-897e-e008bda61ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:13.930590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 145/288] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:13.977911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168d68f-a695-4b20-b4a0-b1352c6df102 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:14.103477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168d68f-a695-4b20-b4a0-b1352c6df102 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:14.148232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:14.149043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:14.149327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:14.149599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:14.168713 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:14.176368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:14.177235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:14.178026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 144/289] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:14.183366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372319-bad9-4bbb-897e-e008bda61ba4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:14.299673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372319-bad9-4bbb-897e-e008bda61ba4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:14.346429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:14.347110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:14.347391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:14.347667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:14.348474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:14.348781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:14.350495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:14.363253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 146/290] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:14.368748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:14.493285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48259280-3bdd-4c94-8a2e-60ef545c3f7b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:14.543975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:14.544867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:14.545150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:14.545425 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] PATH_INFO: `/v3/users/0245c54c4d0a4cdaab090ebb5a378c02` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:14.552625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] RBAC: Authorizing `identity:get_user(user_id=0245c54c4d0a4cdaab090ebb5a378c02)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:14.554180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:14.556000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 145/291] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:14 2022] GET /identity/v3/users/0245c54c4d0a4cdaab090ebb5a378c02 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:14.562063 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:14.694399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb4812-9520-4c02-a3ac-1de2b8f9dcd0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:14.733389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:14.734680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:14.734974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:14.735260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:14.803593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:14.805089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:14.907164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 147/292] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:14.912937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:15.056530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21ff3f-56e0-4f01-833a-87e02601099d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:15.097691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1a31-954b-472d-93cc-b05fa392c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:15.098562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1a31-954b-472d-93cc-b05fa392c362 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.098845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1a31-954b-472d-93cc-b05fa392c362 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.099123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1a31-954b-472d-93cc-b05fa392c362 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.100652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1a31-954b-472d-93cc-b05fa392c362 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:15.102126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1a31-954b-472d-93cc-b05fa392c362 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:15.103837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 146/293] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:14 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:15.110303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:15.244267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b45aa-6fef-47ec-b83b-8aafeefa5767 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:15.279152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece52aa-9664-4a60-8846-d13da7fd2c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:15.279820 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece52aa-9664-4a60-8846-d13da7fd2c03 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.280169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece52aa-9664-4a60-8846-d13da7fd2c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.280689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece52aa-9664-4a60-8846-d13da7fd2c03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.282023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece52aa-9664-4a60-8846-d13da7fd2c03 None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=0245c54c4d0a4cdaab090ebb5a378c02) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:15.282341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece52aa-9664-4a60-8846-d13da7fd2c03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:15.283792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece52aa-9664-4a60-8846-d13da7fd2c03 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:15.290238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 148/294] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:15 2022] GET /identity/v3/role_assignments?user.id=0245c54c4d0a4cdaab090ebb5a378c02&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:15.729311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be244d2-2393-4c3a-bd02-716a05d47537 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.729731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be244d2-2393-4c3a-bd02-716a05d47537 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.729917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be244d2-2393-4c3a-bd02-716a05d47537 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.731577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 147/295] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:15.739813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715b64-4fa8-4c41-aa51-9e91260b9eca None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.740129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715b64-4fa8-4c41-aa51-9e91260b9eca None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.740403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715b64-4fa8-4c41-aa51-9e91260b9eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.757440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d0715b64-4fa8-4c41-aa51-9e91260b9eca None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:15.758624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d0715b64-4fa8-4c41-aa51-9e91260b9eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:15.762645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0f5c-392e-4eef-9b6f-53badf65baef None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.762849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0f5c-392e-4eef-9b6f-53badf65baef None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.763132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0f5c-392e-4eef-9b6f-53badf65baef None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.765540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 148/296] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:15.773704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3fb21-504a-4dff-85db-aded3266ccba None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.773997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3fb21-504a-4dff-85db-aded3266ccba None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.774279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3fb21-504a-4dff-85db-aded3266ccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.797703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bce3fb21-504a-4dff-85db-aded3266ccba None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:15.800125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bce3fb21-504a-4dff-85db-aded3266ccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:15.842720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 149/297] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:15.845158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5358-62c7-4262-8c50-20aebcfcd016 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.845662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5358-62c7-4262-8c50-20aebcfcd016 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.846162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5358-62c7-4262-8c50-20aebcfcd016 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.850024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 150/298] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:15.855732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39674-0698-49d7-8bd6-aa910eb9c5f5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:15.856075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39674-0698-49d7-8bd6-aa910eb9c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:15.856350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39674-0698-49d7-8bd6-aa910eb9c5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:15.876382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e8e39674-0698-49d7-8bd6-aa910eb9c5f5 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:15.877925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e8e39674-0698-49d7-8bd6-aa910eb9c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:15.891127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 149/299] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:15.892115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3fb21-504a-4dff-85db-aded3266ccba None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:15.949989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 151/300] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:15.950683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39674-0698-49d7-8bd6-aa910eb9c5f5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:15.997394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3fb21-504a-4dff-85db-aded3266ccba None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.033065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.033861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.034143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.034417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.046274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:16.054154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:16.055123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:16.056038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 150/301] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:16.057353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39674-0698-49d7-8bd6-aa910eb9c5f5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.060910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.092738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.093569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.093850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.094128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.105009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:16.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:16.113619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:16.114441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 152/302] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:16.115169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.158962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22373-07b1-417c-82c8-c0063cad54a4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.191859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.192703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.192991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.193277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.194466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.195959 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.202279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 151/303] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:16.202279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.214739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d2fcc-0def-4f91-a5c8-712c49c70356 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.247667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.248364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.248641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.248964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.249696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:16.250000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.251377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.259069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 153/304] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:16.259911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.299986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b4735-2e50-4975-8264-312144464ec6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.332539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4e19b-4242-4a52-8f1b-af223d4f32f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.333243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e19b-4242-4a52-8f1b-af223d4f32f1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.333496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e19b-4242-4a52-8f1b-af223d4f32f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.333766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e19b-4242-4a52-8f1b-af223d4f32f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.334598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4e19b-4242-4a52-8f1b-af223d4f32f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:16.334907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4e19b-4242-4a52-8f1b-af223d4f32f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.336382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4e19b-4242-4a52-8f1b-af223d4f32f1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.344556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 152/305] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:16.345845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49c55-6d42-4da4-86e0-dea0411e71fa None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.346133 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49c55-6d42-4da4-86e0-dea0411e71fa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.346399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49c55-6d42-4da4-86e0-dea0411e71fa None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.347743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 153/306] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:16.348370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49c55-6d42-4da4-86e0-dea0411e71fa None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.359934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10e593-6ba0-4237-aa29-6bdc3c979357 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.392725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.393384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.393664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.393908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] PATH_INFO: `/v3/groups` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.394595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.396064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.410085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 154/307] 10.222.0.99 () {60 vars in 1134 bytes} [Fri May 13 14:40:16 2022] POST /identity/v3/groups => generated 229 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:16.410874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.448657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49c55-6d42-4da4-86e0-dea0411e71fa None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.486129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e57aa-1a3e-4012-b8a0-07746a523bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.487021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e57aa-1a3e-4012-b8a0-07746a523bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.487282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e57aa-1a3e-4012-b8a0-07746a523bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.487551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e57aa-1a3e-4012-b8a0-07746a523bf0 None admin] PATH_INFO: `/v3/users/cba4da99a4b34205b645cbaeb4211005` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.502938 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e57aa-1a3e-4012-b8a0-07746a523bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=cba4da99a4b34205b645cbaeb4211005)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.504429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e57aa-1a3e-4012-b8a0-07746a523bf0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.506201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 154/308] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/users/cba4da99a4b34205b645cbaeb4211005 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:16.507540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5c18c-15d0-4738-87a3-bfdd743dc260 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.507822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5c18c-15d0-4738-87a3-bfdd743dc260 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.508121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5c18c-15d0-4738-87a3-bfdd743dc260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.527149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6df5c18c-15d0-4738-87a3-bfdd743dc260 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:16.528460 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6df5c18c-15d0-4738-87a3-bfdd743dc260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:16.534150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27db4-e646-40ab-89e5-41c33d00edde None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.567886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.568702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.568982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.569256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] PATH_INFO: `/v3/users/e8e699e40c4f4fccbf36025f9134db0b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.570489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] RBAC: Authorizing `identity:get_user(user_id=e8e699e40c4f4fccbf36025f9134db0b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.571985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.573895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 155/309] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/users/e8e699e40c4f4fccbf36025f9134db0b => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:16.574472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.602129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 155/310] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:16.602833 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5c18c-15d0-4738-87a3-bfdd743dc260 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.676517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38624-ee4c-4d44-9737-ee4adff48fca None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.698130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5c18c-15d0-4738-87a3-bfdd743dc260 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.710214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408d5b-5229-4920-b777-76df39492930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.711035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408d5b-5229-4920-b777-76df39492930 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.711318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408d5b-5229-4920-b777-76df39492930 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.712045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408d5b-5229-4920-b777-76df39492930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.713191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53408d5b-5229-4920-b777-76df39492930 None admin] RBAC: Adding query filter params (role.id=fddd0c1720504ccb8fe2783b65becad0, user.id=cba4da99a4b34205b645cbaeb4211005, scope.system=all) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:16.713506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53408d5b-5229-4920-b777-76df39492930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.715418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53408d5b-5229-4920-b777-76df39492930 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.728643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 156/311] 10.222.0.99 () {56 vars in 1308 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/role_assignments?user.id=cba4da99a4b34205b645cbaeb4211005&scope.system=all&role.id=fddd0c1720504ccb8fe2783b65becad0 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:16.728643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408d5b-5229-4920-b777-76df39492930 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:16.741235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.742178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.742802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.743082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] PATH_INFO: `/v3/system/users/e8e699e40c4f4fccbf36025f9134db0b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.745249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e8e699e40c4f4fccbf36025f9134db0b, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:16.747443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:16.760235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 156/312] 10.222.0.99 () {58 vars in 1334 bytes} [Fri May 13 14:40:16 2022] PUT /identity/v3/system/users/e8e699e40c4f4fccbf36025f9134db0b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:16.861213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408d5b-5229-4920-b777-76df39492930 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:16.900808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:16.901649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:16.901931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:16.902280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:16.915151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:16.923458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:16.924447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:16.926511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 157/313] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:16.931067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:17.033083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85489bd9-2d4c-4372-9a78-d138892b1527 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:17.069659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:17.070440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:17.070601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:17.070876 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:17.071620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:17.071954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:17.073465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:17.081919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 157/314] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:17.087214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:17.187928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e364ef5-6442-449c-a760-ce6168a4626d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:17.221069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:17.221960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:17.222242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:17.222512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] PATH_INFO: `/v3/users/dd1dfc0292244470bcbefd7aed418c2b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:17.223750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] RBAC: Authorizing `identity:get_user(user_id=dd1dfc0292244470bcbefd7aed418c2b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:17.225563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:17.227533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 158/315] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:17 2022] GET /identity/v3/users/dd1dfc0292244470bcbefd7aed418c2b => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:17.233057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:17.337283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8ee4b-5e16-4b79-829c-4106fc837909 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:17.371895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:17.372531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:17.372811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:17.373099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:17.438981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:17.440422 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:17.537166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 158/316] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:17.542426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:17.644936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bdb88-0914-4d0c-ae8d-fb478e187698 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:17.679160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c99817-767b-44f8-8dc0-faadea518dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:17.680067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99817-767b-44f8-8dc0-faadea518dcc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:17.680353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99817-767b-44f8-8dc0-faadea518dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:17.680624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99817-767b-44f8-8dc0-faadea518dcc None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:17.681799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c99817-767b-44f8-8dc0-faadea518dcc None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:17.683247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c99817-767b-44f8-8dc0-faadea518dcc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:17.685262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 159/317] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:17 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:17.691155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:17.787223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cddd1-de73-4199-ac3c-317217e24c80 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:17.822346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1be97-6cae-4187-a257-4302072746a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:17.822935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1be97-6cae-4187-a257-4302072746a4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:17.823212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1be97-6cae-4187-a257-4302072746a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:17.823483 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1be97-6cae-4187-a257-4302072746a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:17.824355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1be97-6cae-4187-a257-4302072746a4 None admin] RBAC: Adding query filter params (role.id=fddd0c1720504ccb8fe2783b65becad0, scope.project.id=740d00875c1549f9978dbba7e8d50689, user.id=dd1dfc0292244470bcbefd7aed418c2b) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:17.824666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1be97-6cae-4187-a257-4302072746a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:17.826126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1be97-6cae-4187-a257-4302072746a4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:17.832097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 159/318] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:17 2022] GET /identity/v3/role_assignments?user.id=dd1dfc0292244470bcbefd7aed418c2b&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=fddd0c1720504ccb8fe2783b65becad0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:18.685850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb670-cab9-45c6-84ec-f88742e33cea None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:18.686480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb670-cab9-45c6-84ec-f88742e33cea None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:18.686785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb670-cab9-45c6-84ec-f88742e33cea None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:18.688209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 160/319] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:18.693560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f617be-d077-41c9-ae93-966ac793d394 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:18.693979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f617be-d077-41c9-ae93-966ac793d394 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:18.694072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f617be-d077-41c9-ae93-966ac793d394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:18.711158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-65f617be-d077-41c9-ae93-966ac793d394 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:18.712411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-65f617be-d077-41c9-ae93-966ac793d394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:18.779360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 160/320] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:18.801020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb670-cab9-45c6-84ec-f88742e33cea None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:18.913929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb670-cab9-45c6-84ec-f88742e33cea None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:18.946709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b06b-6b36-4efc-9b51-a52bd35e9a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:18.947509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b06b-6b36-4efc-9b51-a52bd35e9a01 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:18.947795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b06b-6b36-4efc-9b51-a52bd35e9a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:18.948114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b06b-6b36-4efc-9b51-a52bd35e9a01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:18.949285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b06b-6b36-4efc-9b51-a52bd35e9a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:18.950758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b06b-6b36-4efc-9b51-a52bd35e9a01 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:18.957300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 161/321] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:18.959917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f617be-d077-41c9-ae93-966ac793d394 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.016391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3afb9-3db6-443e-b47e-ecfdcf6f3b6d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.016627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3afb9-3db6-443e-b47e-ecfdcf6f3b6d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.016908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3afb9-3db6-443e-b47e-ecfdcf6f3b6d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.018278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 162/322] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:19.023253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469cf14-e6a0-41d4-bc53-f8887e8e7d98 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.023539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469cf14-e6a0-41d4-bc53-f8887e8e7d98 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.023784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469cf14-e6a0-41d4-bc53-f8887e8e7d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.041727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0469cf14-e6a0-41d4-bc53-f8887e8e7d98 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:19.042830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0469cf14-e6a0-41d4-bc53-f8887e8e7d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:19.061020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f617be-d077-41c9-ae93-966ac793d394 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.093729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c9f9-39d3-403d-b253-7a8363a2b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.094392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c9f9-39d3-403d-b253-7a8363a2b7ee None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.094669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c9f9-39d3-403d-b253-7a8363a2b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.094939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c9f9-39d3-403d-b253-7a8363a2b7ee None admin] PATH_INFO: `/v3/groups` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.095613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9c9f9-39d3-403d-b253-7a8363a2b7ee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:19.097099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9c9f9-39d3-403d-b253-7a8363a2b7ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:19.109080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 163/323] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:19.110421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20019887-180d-496a-a7f9-144cfd8b620d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.110713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20019887-180d-496a-a7f9-144cfd8b620d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.110991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20019887-180d-496a-a7f9-144cfd8b620d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.115920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 161/324] 10.222.0.99 () {60 vars in 1134 bytes} [Fri May 13 14:40:18 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:19.116078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 164/325] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:19.121612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b07cd-788c-4541-8495-78f8c7a60b8a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.121980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b07cd-788c-4541-8495-78f8c7a60b8a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.122318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b07cd-788c-4541-8495-78f8c7a60b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.131723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20019887-180d-496a-a7f9-144cfd8b620d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.140563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-094b07cd-788c-4541-8495-78f8c7a60b8a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:19.141798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-094b07cd-788c-4541-8495-78f8c7a60b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:19.210678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 162/326] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:19.234910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b07cd-788c-4541-8495-78f8c7a60b8a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.239303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20019887-180d-496a-a7f9-144cfd8b620d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.275841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.276758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.277045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.277320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.288824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:19.296769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:19.297630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:19.298401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 165/327] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:19.303754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.345692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b07cd-788c-4541-8495-78f8c7a60b8a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.382614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.383428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.383707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.384036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.396796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:19.405729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:19.406631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:19.407575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 163/328] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:19.411557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce74d21-00e3-4d6e-ad10-84f7c3256197 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.413030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.446681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.447350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.447647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.447953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.448810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:19.449170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:19.450608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:19.460000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 166/329] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:19.465868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.541410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0709399-aa88-4e51-b79d-98c4b213da3d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.578649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608d60b-00c8-4a11-9bcd-d0cb223921cc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.579624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.580576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.581681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.581964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.582734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:19.583049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:19.584489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:19.594902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 164/330] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:19.601338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.622671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.623759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.624123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.624697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] PATH_INFO: `/v3/users/cba4da99a4b34205b645cbaeb4211005` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.625934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] RBAC: Authorizing `identity:get_user(user_id=cba4da99a4b34205b645cbaeb4211005)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:19.627832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:19.630048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 167/331] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:19 2022] GET /identity/v3/users/cba4da99a4b34205b645cbaeb4211005 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:19.635890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.716672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d24776-8170-4267-b11f-c9c5d0888bca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.750555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838a1f4-da6d-4818-8ca8-68f6ecdf42ab None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.752694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.753656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.753940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.754218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] PATH_INFO: `/v3/users/e8e699e40c4f4fccbf36025f9134db0b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.755507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] RBAC: Authorizing `identity:get_user(user_id=e8e699e40c4f4fccbf36025f9134db0b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:19.757067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:19.759097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 165/332] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:19 2022] GET /identity/v3/users/e8e699e40c4f4fccbf36025f9134db0b => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:19.773620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:19.796969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310af5a-7097-49fa-b2fd-8bd26ec25752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.798300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310af5a-7097-49fa-b2fd-8bd26ec25752 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.798794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310af5a-7097-49fa-b2fd-8bd26ec25752 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.799264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310af5a-7097-49fa-b2fd-8bd26ec25752 None admin] PATH_INFO: `/v3/system/users/cba4da99a4b34205b645cbaeb4211005/roles/fddd0c1720504ccb8fe2783b65becad0` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.801436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310af5a-7097-49fa-b2fd-8bd26ec25752 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cba4da99a4b34205b645cbaeb4211005, role_id=fddd0c1720504ccb8fe2783b65becad0)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:19.803176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310af5a-7097-49fa-b2fd-8bd26ec25752 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:19.817048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 168/333] 10.222.0.99 () {58 vars in 1334 bytes} [Fri May 13 14:40:19 2022] PUT /identity/v3/system/users/cba4da99a4b34205b645cbaeb4211005/roles/fddd0c1720504ccb8fe2783b65becad0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:19.895814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a955-88ae-463d-972d-714458bf6b42 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:19.934517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c752b-7a74-4b3c-95a5-54860bff41c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:19.935242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c752b-7a74-4b3c-95a5-54860bff41c5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:19.935523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c752b-7a74-4b3c-95a5-54860bff41c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:19.935796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c752b-7a74-4b3c-95a5-54860bff41c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:19.937125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c752b-7a74-4b3c-95a5-54860bff41c5 None admin] RBAC: Adding query filter params (role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, user.id=e8e699e40c4f4fccbf36025f9134db0b, scope.system=all) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:19.937623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c752b-7a74-4b3c-95a5-54860bff41c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:19.939163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c752b-7a74-4b3c-95a5-54860bff41c5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:19.953412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 166/334] 10.222.0.99 () {56 vars in 1308 bytes} [Fri May 13 14:40:19 2022] GET /identity/v3/role_assignments?user.id=e8e699e40c4f4fccbf36025f9134db0b&scope.system=all&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:21.799902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5d6af-2cd3-45f7-97dc-3a0e212357b6 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:21.800421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5d6af-2cd3-45f7-97dc-3a0e212357b6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:21.800421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5d6af-2cd3-45f7-97dc-3a0e212357b6 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:21.801761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 169/335] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:21.807159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559669-7526-4966-b9fb-a9d42c5236d7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:21.807599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559669-7526-4966-b9fb-a9d42c5236d7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:21.807773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559669-7526-4966-b9fb-a9d42c5236d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:21.828856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4b559669-7526-4966-b9fb-a9d42c5236d7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:21.830073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4b559669-7526-4966-b9fb-a9d42c5236d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:21.909259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 167/336] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:21.947108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5d6af-2cd3-45f7-97dc-3a0e212357b6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:22.065081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5d6af-2cd3-45f7-97dc-3a0e212357b6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:22.103438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b96c-c86c-4eef-82f4-19aba0b2ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:22.104302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b96c-c86c-4eef-82f4-19aba0b2ec67 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.104586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b96c-c86c-4eef-82f4-19aba0b2ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.104865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b96c-c86c-4eef-82f4-19aba0b2ec67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.115601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4b96c-c86c-4eef-82f4-19aba0b2ec67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-34e4b96c-c86c-4eef-82f4-19aba0b2ec67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:22.123388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:22.125520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:22.127428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 170/337] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:22.135897 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559669-7526-4966-b9fb-a9d42c5236d7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:22.232048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559669-7526-4966-b9fb-a9d42c5236d7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:22.266510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:22.267278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.267567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.267847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.268636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:22.270428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2fb1-8d9b-4acb-99f5-26517a207042 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.270710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2fb1-8d9b-4acb-99f5-26517a207042 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.270984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2fb1-8d9b-4acb-99f5-26517a207042 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.272400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 171/338] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:22.272584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:22.274092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:22.277812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e072-75c1-4a7f-bdd9-e4556209e619 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.278095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e072-75c1-4a7f-bdd9-e4556209e619 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.278374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e072-75c1-4a7f-bdd9-e4556209e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.288371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 168/339] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:22.290018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:22.320978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3933e072-75c1-4a7f-bdd9-e4556209e619 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:22.322135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3933e072-75c1-4a7f-bdd9-e4556209e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:22.475678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 172/340] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:22.486237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad4e2-4522-4804-89af-78e1d4672904 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:22.505224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933e072-75c1-4a7f-bdd9-e4556209e619 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:22.528659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:22.529334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.529649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.530314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.627234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:22.628669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:22.666842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933e072-75c1-4a7f-bdd9-e4556209e619 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:22.723379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:22.724540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.724827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.725109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.739946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:22.756190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:22.757166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:22.757962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:22.758573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 173/341] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:22.764067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:22.771263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 169/342] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:40:22.777061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:22.894742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b919957-b643-4459-8183-06126aaecde2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:22.919012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844186b-0603-42db-9260-379983b6ecbb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:22.930841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef534e8b-9dca-4633-8dfa-989997221942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:22.931723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef534e8b-9dca-4633-8dfa-989997221942 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.932045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef534e8b-9dca-4633-8dfa-989997221942 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.932319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef534e8b-9dca-4633-8dfa-989997221942 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.933518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef534e8b-9dca-4633-8dfa-989997221942 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:22.934995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef534e8b-9dca-4633-8dfa-989997221942 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:22.943762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 170/343] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:22 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:22.943762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758aca-26f6-4080-8334-5f239df43314 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:22.943762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758aca-26f6-4080-8334-5f239df43314 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:22.943762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758aca-26f6-4080-8334-5f239df43314 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:22.944971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 171/344] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:22.946458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758aca-26f6-4080-8334-5f239df43314 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.012572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac97da-ffc0-40a6-93eb-a1ff843606f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.013660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac97da-ffc0-40a6-93eb-a1ff843606f0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.014214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac97da-ffc0-40a6-93eb-a1ff843606f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.014702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac97da-ffc0-40a6-93eb-a1ff843606f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.015666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac97da-ffc0-40a6-93eb-a1ff843606f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:23.016194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac97da-ffc0-40a6-93eb-a1ff843606f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:23.017808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac97da-ffc0-40a6-93eb-a1ff843606f0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:23.035328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 174/345] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:23.036990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb2103-af92-49d3-bc76-0b13cbff7aa6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.037489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb2103-af92-49d3-bc76-0b13cbff7aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.037963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb2103-af92-49d3-bc76-0b13cbff7aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.052239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758aca-26f6-4080-8334-5f239df43314 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.077473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2ddb2103-af92-49d3-bc76-0b13cbff7aa6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:23.079988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2ddb2103-af92-49d3-bc76-0b13cbff7aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:23.087757 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.088704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.088985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.089260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.095902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:23.097489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:23.099626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 172/346] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:22 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:23.100444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.214374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bfc02-77c2-4cff-8299-9e1b16cb1cc2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.226756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 175/347] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:23.227849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb2103-af92-49d3-bc76-0b13cbff7aa6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.248919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.249628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.249915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.250195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.320180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:23.321664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:23.385345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb2103-af92-49d3-bc76-0b13cbff7aa6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.423956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76990523-cf2b-4bfb-89e3-b0f5e006e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.424665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76990523-cf2b-4bfb-89e3-b0f5e006e85c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.425031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 173/348] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:23.425148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76990523-cf2b-4bfb-89e3-b0f5e006e85c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.425238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76990523-cf2b-4bfb-89e3-b0f5e006e85c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.425788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.426035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76990523-cf2b-4bfb-89e3-b0f5e006e85c None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=41cd21a482424d49974c940f0f74a43f) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:23.426345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76990523-cf2b-4bfb-89e3-b0f5e006e85c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:23.432817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76990523-cf2b-4bfb-89e3-b0f5e006e85c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:23.440912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 176/349] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:23.442309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7815-3c52-4fc5-bfdc-1b67ec971e71 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.442597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7815-3c52-4fc5-bfdc-1b67ec971e71 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.442871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7815-3c52-4fc5-bfdc-1b67ec971e71 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.445121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 177/350] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:23.445875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b7815-3c52-4fc5-bfdc-1b67ec971e71 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.597833 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8012c-ae85-4b33-867d-6cac399da7c7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.600824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b7815-3c52-4fc5-bfdc-1b67ec971e71 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.636655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb612fc5-c9f9-4688-ab88-ffddfa31ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.637131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d5280-a98b-4568-b419-0e8b49826cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.637523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612fc5-c9f9-4688-ab88-ffddfa31ca8a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.637811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612fc5-c9f9-4688-ab88-ffddfa31ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.638011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d5280-a98b-4568-b419-0e8b49826cbf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.638112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612fc5-c9f9-4688-ab88-ffddfa31ca8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.638300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d5280-a98b-4568-b419-0e8b49826cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.638573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d5280-a98b-4568-b419-0e8b49826cbf None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.640117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d5280-a98b-4568-b419-0e8b49826cbf None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:23.641590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d5280-a98b-4568-b419-0e8b49826cbf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:23.643686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 178/351] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:23.645056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efec7e-a8a9-4fbe-85f6-d5ded6093fdc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.645351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efec7e-a8a9-4fbe-85f6-d5ded6093fdc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.645629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efec7e-a8a9-4fbe-85f6-d5ded6093fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.650797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb612fc5-c9f9-4688-ab88-ffddfa31ca8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fb612fc5-c9f9-4688-ab88-ffddfa31ca8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:23.659224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:23.660480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:40:23.661427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:23.663936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 174/352] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:23.665532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953b1e4-26d6-4bdf-a52e-93b38c4d5ee2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.665978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953b1e4-26d6-4bdf-a52e-93b38c4d5ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.666434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953b1e4-26d6-4bdf-a52e-93b38c4d5ee2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.667958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 175/353] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:23.668790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953b1e4-26d6-4bdf-a52e-93b38c4d5ee2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.670172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d9efec7e-a8a9-4fbe-85f6-d5ded6093fdc None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:23.671591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d9efec7e-a8a9-4fbe-85f6-d5ded6093fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:23.742727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 179/354] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:23.744186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305698-7056-4971-ac66-13928cf62639 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.744566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305698-7056-4971-ac66-13928cf62639 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.744913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305698-7056-4971-ac66-13928cf62639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.761455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-65305698-7056-4971-ac66-13928cf62639 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:23.762793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-65305698-7056-4971-ac66-13928cf62639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:23.781153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953b1e4-26d6-4bdf-a52e-93b38c4d5ee2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.817011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.818223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.818677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.819190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.820616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:23.822356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:23.824301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 176/355] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:23.825272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.840937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 180/356] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:23.841826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305698-7056-4971-ac66-13928cf62639 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:23.938061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f96ef-ccf0-4aaa-bffd-2ea81baa0130 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.980765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:23.981444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:23.981731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:23.982006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:23.982793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:23.983097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:23.984557 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:23.990899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305698-7056-4971-ac66-13928cf62639 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:23.996444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 177/357] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:23.997377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.030243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.031471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.032010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.032508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.044908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:24.053508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:24.054426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:24.055209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:24.058000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 181/358] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:24.059000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.119670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef7a6c-0974-4757-bf9b-5ae1425fc695 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.174242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.174913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.175192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.175463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.176526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=41cd21a482424d49974c940f0f74a43f) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:24.176837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:24.178827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:24.179921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c6505-a2b5-46c5-9ed1-567f10e57966 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.185843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 178/359] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:23 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=926ac669ff214536b6ec0876b5669dbc => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:24.186805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.227350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.229111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.229671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.230132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.247978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:24.259530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:24.260515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:24.261355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:24.264991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 182/360] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:24.267028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.326687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec64775-58ca-4bb9-b47e-1654191838a6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.393343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.394246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.394522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.394789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] PATH_INFO: `/v3/users/cba4da99a4b34205b645cbaeb4211005` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.400746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] RBAC: Authorizing `identity:get_user(user_id=cba4da99a4b34205b645cbaeb4211005)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:24.402246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:24.404894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 179/361] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:40:24 2022] GET /identity/v3/users/cba4da99a4b34205b645cbaeb4211005 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:24.405057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.413868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c6829-d7a4-4a2f-9395-7d148dc98698 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.488689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.489689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.492740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.493211 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.494139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:24.494594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:24.496175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:24.506018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 183/362] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:24.507096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.599748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917203a1-c360-49e4-9bf8-ef9f39efad63 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.615293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b36f-e45d-4c30-9179-f4dbdd25165a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.634435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.635460 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.636059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.636272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.637017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:24.637319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:24.638693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:24.647886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 180/363] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:24.648800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.650267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5d2fd-15cb-4317-851a-9b0d6295e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.651107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d2fd-15cb-4317-851a-9b0d6295e93a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.651526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d2fd-15cb-4317-851a-9b0d6295e93a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.656007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5d2fd-15cb-4317-851a-9b0d6295e93a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.657078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d2fd-15cb-4317-851a-9b0d6295e93a None admin] RBAC: Adding query filter params (role.id=fddd0c1720504ccb8fe2783b65becad0, user.id=cba4da99a4b34205b645cbaeb4211005, scope.system=all) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:24.657561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d2fd-15cb-4317-851a-9b0d6295e93a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:24.659150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5d2fd-15cb-4317-851a-9b0d6295e93a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:24.671787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 184/364] 10.222.0.99 () {56 vars in 1308 bytes} [Fri May 13 14:40:24 2022] GET /identity/v3/role_assignments?user.id=cba4da99a4b34205b645cbaeb4211005&scope.system=all&role.id=fddd0c1720504ccb8fe2783b65becad0 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:24.673307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f8db0-4a76-4aa7-b9f6-6596ecbdf906 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.673736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f8db0-4a76-4aa7-b9f6-6596ecbdf906 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.674153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f8db0-4a76-4aa7-b9f6-6596ecbdf906 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.675830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 185/365] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:24.676718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f8db0-4a76-4aa7-b9f6-6596ecbdf906 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:24.784980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f8db0-4a76-4aa7-b9f6-6596ecbdf906 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.820440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c497e1-f8d9-4c28-b5e1-d49c487840d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.821411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c497e1-f8d9-4c28-b5e1-d49c487840d8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.821840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c497e1-f8d9-4c28-b5e1-d49c487840d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.822249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c497e1-f8d9-4c28-b5e1-d49c487840d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.837907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efa05-ef26-4345-a096-f66f4585b97a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:24.889847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:24.890438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:24.890722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:24.890998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:24.895817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c497e1-f8d9-4c28-b5e1-d49c487840d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:24.897541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c497e1-f8d9-4c28-b5e1-d49c487840d8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:24.979428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:24.983199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.006644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 186/366] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:25.008540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a912-2331-424d-9dd2-c9fef59ca6f2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.008964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a912-2331-424d-9dd2-c9fef59ca6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.009405 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a912-2331-424d-9dd2-c9fef59ca6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.029866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f319a912-2331-424d-9dd2-c9fef59ca6f2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:25.030808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f319a912-2331-424d-9dd2-c9fef59ca6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:25.106509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 181/367] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:25.107735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.116669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 187/368] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:25.117531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319a912-2331-424d-9dd2-c9fef59ca6f2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.217340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319a912-2331-424d-9dd2-c9fef59ca6f2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.232330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38e916-6123-4443-a8b6-e1bd5473db02 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.252986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.254309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.254784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.255248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.256660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:25.258303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.260565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 188/369] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:25.261599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.268611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.269478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.269768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.270036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.271916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:25.273224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.280210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 182/370] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:25.281037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.378114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce9637-1524-49ed-a12e-7745735fc0b1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.409847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af886-c9d7-4473-ab29-7507515efe7a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.418323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.419241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.419618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.420022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.430799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:25.439771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:25.440869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:25.441845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:25.447232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 189/371] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:25.447232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.457558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.458964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.459243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.459790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.465036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:25.466024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.469063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 183/372] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:25.470814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.570083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6776-b008-4ca7-af79-95ae84497e1d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.603634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e739c-2421-41df-9154-c21802f2c173 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.614616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.616137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.616896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.617400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.619390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:25.621349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.623695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 190/373] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:25.624733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.643261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.643955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.644239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.644525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.645269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:25.645572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:25.646974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.655994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 184/374] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:25.657121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.743679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dce7b-fd5b-4131-9d6b-66edddbcacb5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.766633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cadbae-4379-40fd-b871-d79e5d005a94 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.778599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.779807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.780314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.780802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.781931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=740d00875c1549f9978dbba7e8d50689) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:25.782975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:25.785151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.794346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 191/375] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:25.796009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:25.803091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.803783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.804093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.804373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:25.805236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=740d00875c1549f9978dbba7e8d50689) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:25.805552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:25.807068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:25.815600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 185/376] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=926ac669ff214536b6ec0876b5669dbc => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:25.911400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127420-8137-4313-bd5c-59c8130075ac None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:25.952963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:25.954574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:25.955406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:25.956235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:26.035260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:26.037558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:26.153239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 192/377] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:26.160176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:26.288254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8d4aa-f21e-4b66-a67a-7a8669dce3cd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:26.321421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295daf8b-ee3e-472e-8f62-b5b9a582c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:26.322291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295daf8b-ee3e-472e-8f62-b5b9a582c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:26.322564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295daf8b-ee3e-472e-8f62-b5b9a582c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:26.322838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295daf8b-ee3e-472e-8f62-b5b9a582c1a1 None admin] PATH_INFO: `/v3/projects/874372a810af4de2a4ad12d67714243a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:26.324057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295daf8b-ee3e-472e-8f62-b5b9a582c1a1 None admin] RBAC: Authorizing `identity:get_project(project_id=874372a810af4de2a4ad12d67714243a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:26.325523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295daf8b-ee3e-472e-8f62-b5b9a582c1a1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:26.327623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 186/378] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:26 2022] GET /identity/v3/projects/874372a810af4de2a4ad12d67714243a => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:26.332970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:26.387892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908c8e-5f71-49c8-855b-3bd6989de598 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:26.388216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908c8e-5f71-49c8-855b-3bd6989de598 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:26.388466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908c8e-5f71-49c8-855b-3bd6989de598 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:26.390196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 187/379] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:26.395381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd198-053a-4f90-b4ef-be354c912534 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:26.395669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd198-053a-4f90-b4ef-be354c912534 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:26.395987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd198-053a-4f90-b4ef-be354c912534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:26.414553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fd3bd198-053a-4f90-b4ef-be354c912534 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:26.416077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fd3bd198-053a-4f90-b4ef-be354c912534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:26.506381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60303f-2a5c-4d63-930a-76aa23388f76 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:26.529492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 188/380] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:26.558844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:26.559640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:26.559942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:26.560224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] PATH_INFO: `/v3/groups/3cf25da79fce434eae5a2606f69f82b7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:26.572362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] RBAC: Authorizing `identity:get_group(group_id=3cf25da79fce434eae5a2606f69f82b7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:26.573833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:26.575895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 193/381] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:26 2022] GET /identity/v3/groups/3cf25da79fce434eae5a2606f69f82b7 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:26.582203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd198-053a-4f90-b4ef-be354c912534 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:26.590508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:26.732280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d598a6-d3d9-4417-a6d9-2ec0eb7e94be None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:26.750428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd198-053a-4f90-b4ef-be354c912534 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:26.770844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:26.771667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:26.772273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:26.772273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:26.799237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:26.808548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:26.809461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:26.810262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 194/382] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:26.817436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:26.822755 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:26.823430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:26.823708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:26.824085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:26.824840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] RBAC: Adding query filter params (group.id=3cf25da79fce434eae5a2606f69f82b7, role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=874372a810af4de2a4ad12d67714243a) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:26.825902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:26.826691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:26.837248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 189/383] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:26 2022] GET /identity/v3/role_assignments?group.id=3cf25da79fce434eae5a2606f69f82b7&scope.project.id=874372a810af4de2a4ad12d67714243a&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:26.960017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256b4df-cb18-4e90-a102-353f68c923e9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:27.002814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277afd6e-7f6c-466d-9ba7-aa920c2561ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:27.003507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277afd6e-7f6c-466d-9ba7-aa920c2561ff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.003795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277afd6e-7f6c-466d-9ba7-aa920c2561ff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.004100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277afd6e-7f6c-466d-9ba7-aa920c2561ff None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.004877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277afd6e-7f6c-466d-9ba7-aa920c2561ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:27.005188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277afd6e-7f6c-466d-9ba7-aa920c2561ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:27.006687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277afd6e-7f6c-466d-9ba7-aa920c2561ff None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:27.020325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 195/384] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:27.025802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:27.130526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a9149-4715-426f-a586-2a3fde8e0428 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:27.145050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae4f6-e8e1-40c5-b335-664ecf45e58d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.145546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae4f6-e8e1-40c5-b335-664ecf45e58d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.146658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae4f6-e8e1-40c5-b335-664ecf45e58d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.149817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 196/385] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:27.154356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28373-d348-49f6-b27a-c3ca25d03226 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.154829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28373-d348-49f6-b27a-c3ca25d03226 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.155341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c28373-d348-49f6-b27a-c3ca25d03226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.183907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e8c28373-d348-49f6-b27a-c3ca25d03226 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:27.185097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e8c28373-d348-49f6-b27a-c3ca25d03226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:27.185318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:27.186927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.187366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.187817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.189466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:27.191102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:27.194175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 190/386] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:27 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:27.204395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:27.314239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc94af-4989-4bbc-9221-546f2dd7a080 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:27.355073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:27.358155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.358597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.359013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.361951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:27.364546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:27.368528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 191/387] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:27 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:27.372959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 197/388] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:27.376861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:27.429174 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c28373-d348-49f6-b27a-c3ca25d03226 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:27.559648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226992-7301-49e8-87d0-5ed7f4fa1424 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:27.577528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c28373-d348-49f6-b27a-c3ca25d03226 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:27.620473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:27.621296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.621576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.621853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.630607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:27.631500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.631781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.632089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f/groups/e158501b03cf4944bf878f6c6793a893/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.634868 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] RBAC: Authorizing `identity:create_grant(project_id=41cd21a482424d49974c940f0f74a43f, group_id=e158501b03cf4944bf878f6c6793a893, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:27.636356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:27.645500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:27.658657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 192/389] 10.222.0.99 () {58 vars in 1442 bytes} [Fri May 13 14:40:27 2022] PUT /identity/v3/projects/41cd21a482424d49974c940f0f74a43f/groups/e158501b03cf4944bf878f6c6793a893/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:27.661398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:27.662304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:27.663116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 198/390] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:27.669018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:27.780960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850f9e-ddae-4053-a63c-97e404168a1b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:27.820717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:27.821415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:27.821698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:27.821977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:27.822744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:27.823051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:27.824491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:27.833668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 193/391] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:27.839356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:27.955266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fec1e-4d8d-4182-97bb-74d0d271c05d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:28.000749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:28.001629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:28.001909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:28.002183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:28.003379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:28.004874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:28.006825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 199/392] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:27 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:28.012361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:28.139144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d2fa7-ec18-4df5-8a23-44c85f1a4834 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:28.175560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e89e8-d032-45f8-b843-4b900d3c3ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:28.176844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e89e8-d032-45f8-b843-4b900d3c3ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:28.177327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e89e8-d032-45f8-b843-4b900d3c3ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:28.177794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e89e8-d032-45f8-b843-4b900d3c3ac1 None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:28.179200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e89e8-d032-45f8-b843-4b900d3c3ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:28.180886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e89e8-d032-45f8-b843-4b900d3c3ac1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:28.182801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 194/393] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:28 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:28.188631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:28.343667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088f11-58f2-4461-914a-8a1d0aabdf2e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:28.386890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998fb42-58ed-4f4c-979e-ab36912c36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:28.387782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998fb42-58ed-4f4c-979e-ab36912c36ec None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:28.388117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998fb42-58ed-4f4c-979e-ab36912c36ec None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:28.388391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998fb42-58ed-4f4c-979e-ab36912c36ec None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f/groups/e158501b03cf4944bf878f6c6793a893/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:28.391350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998fb42-58ed-4f4c-979e-ab36912c36ec None admin] RBAC: Authorizing `identity:create_grant(project_id=41cd21a482424d49974c940f0f74a43f, group_id=e158501b03cf4944bf878f6c6793a893, role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:28.392843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998fb42-58ed-4f4c-979e-ab36912c36ec None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:28.413170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 200/394] 10.222.0.99 () {58 vars in 1442 bytes} [Fri May 13 14:40:28 2022] PUT /identity/v3/projects/41cd21a482424d49974c940f0f74a43f/groups/e158501b03cf4944bf878f6c6793a893/roles/926ac669ff214536b6ec0876b5669dbc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:28.754520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ac06-232e-4bbc-ba4a-1de3c13cac8b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:28.755039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ac06-232e-4bbc-ba4a-1de3c13cac8b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:28.755456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661ac06-232e-4bbc-ba4a-1de3c13cac8b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:28.758869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 195/395] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:28.766473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54ae45-7e54-41ed-8fb7-f5690f5af05e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:28.767062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54ae45-7e54-41ed-8fb7-f5690f5af05e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:28.767536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54ae45-7e54-41ed-8fb7-f5690f5af05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:28.788681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1d54ae45-7e54-41ed-8fb7-f5690f5af05e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:28.790179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1d54ae45-7e54-41ed-8fb7-f5690f5af05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:28.865984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 201/396] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:28.898391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661ac06-232e-4bbc-ba4a-1de3c13cac8b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:29.072708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661ac06-232e-4bbc-ba4a-1de3c13cac8b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:29.112970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8cf9-a5e8-4e7c-afef-ab27e551b9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:29.114261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8cf9-a5e8-4e7c-afef-ab27e551b9ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.114739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8cf9-a5e8-4e7c-afef-ab27e551b9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.115231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8cf9-a5e8-4e7c-afef-ab27e551b9ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.126966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8cf9-a5e8-4e7c-afef-ab27e551b9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-626e8cf9-a5e8-4e7c-afef-ab27e551b9ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:29.140146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:29.141072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:29.141869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:29.144702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 196/397] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:29.150961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54ae45-7e54-41ed-8fb7-f5690f5af05e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:29.172772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f01da-4413-4337-8943-68a6bef529e6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.173088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f01da-4413-4337-8943-68a6bef529e6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.173356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f01da-4413-4337-8943-68a6bef529e6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.174824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 197/398] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:29.181095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2429cd-013a-4c1a-9ae3-18711117f38e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.181648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2429cd-013a-4c1a-9ae3-18711117f38e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.182121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2429cd-013a-4c1a-9ae3-18711117f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.201954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3a2429cd-013a-4c1a-9ae3-18711117f38e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:29.203679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3a2429cd-013a-4c1a-9ae3-18711117f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:29.323092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54ae45-7e54-41ed-8fb7-f5690f5af05e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:29.330574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 198/399] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:29.379484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:29.380087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2429cd-013a-4c1a-9ae3-18711117f38e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:29.380882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.381361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.381844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.382796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:29.383294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:29.385051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:29.394399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 202/400] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:29.401476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:29.581069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2429cd-013a-4c1a-9ae3-18711117f38e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:29.596251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8552c-7777-452c-a6cb-e2be0d422db9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:29.643742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:29.644954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.646158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.646637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.658425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:29.659300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.659582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.659851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.660797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:29.664561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:29.666043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:29.668058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 203/401] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:29 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:29.669486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:29.670439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:29.671223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:29.675630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:29.676533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 199/402] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:29.682318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:29.792683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d52a5f-9c45-44be-9916-8a64213caab0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:29.837156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75277fb2-5c3d-4e0f-9131-8e9a5163021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:29.838250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277fb2-5c3d-4e0f-9131-8e9a5163021c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.838798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277fb2-5c3d-4e0f-9131-8e9a5163021c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.839265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277fb2-5c3d-4e0f-9131-8e9a5163021c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.840273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75277fb2-5c3d-4e0f-9131-8e9a5163021c None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:29.840781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75277fb2-5c3d-4e0f-9131-8e9a5163021c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:29.842493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75277fb2-5c3d-4e0f-9131-8e9a5163021c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:29.851515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adfbcb-b67a-4355-9fc4-bb1e4e23ad24 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:29.854372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 200/403] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:29.856074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8f71-9cbd-457c-a85d-98ae51437ae1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.856560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8f71-9cbd-457c-a85d-98ae51437ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.857107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8f71-9cbd-457c-a85d-98ae51437ae1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.859199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 201/404] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:29.868353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a8f71-9cbd-457c-a85d-98ae51437ae1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:29.898749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5b524-4854-4740-8866-8b361a3bd4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:29.900066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b524-4854-4740-8866-8b361a3bd4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.900611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b524-4854-4740-8866-8b361a3bd4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.901081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b524-4854-4740-8866-8b361a3bd4d8 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.902513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5b524-4854-4740-8866-8b361a3bd4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:29.904572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5b524-4854-4740-8866-8b361a3bd4d8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:29.907180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 204/405] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:29 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:29.908769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bbe23-45ff-4e71-b853-245663ea1b2c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:29.909294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bbe23-45ff-4e71-b853-245663ea1b2c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:29.909776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bbe23-45ff-4e71-b853-245663ea1b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:29.930640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-891bbe23-45ff-4e71-b853-245663ea1b2c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:29.932977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-891bbe23-45ff-4e71-b853-245663ea1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:29.983343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a8f71-9cbd-457c-a85d-98ae51437ae1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.019925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 205/406] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:30.019925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bbe23-45ff-4e71-b853-245663ea1b2c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.032751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.033952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.034465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.034926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.036951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:30.039111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:30.042854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 202/407] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:29 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:30.048308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.160537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bbe23-45ff-4e71-b853-245663ea1b2c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.173075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dd247-79b6-45bb-90c8-860264d6dc4a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.212096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.213039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.213838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.214115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689/groups/e158501b03cf4944bf878f6c6793a893/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.217379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] RBAC: Authorizing `identity:create_grant(project_id=740d00875c1549f9978dbba7e8d50689, group_id=e158501b03cf4944bf878f6c6793a893, role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:30.218956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:30.221194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.222994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.223463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.223862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.240954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 206/408] 10.222.0.99 () {58 vars in 1442 bytes} [Fri May 13 14:40:30 2022] PUT /identity/v3/projects/740d00875c1549f9978dbba7e8d50689/groups/e158501b03cf4944bf878f6c6793a893/roles/926ac669ff214536b6ec0876b5669dbc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:30.242156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.247329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:30.256048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:30.256991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:30.257772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:30.260586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 203/409] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:30.267892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.380725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e3bd8-7e27-4d3c-8319-e6b0c768ecbb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.392320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cdffe-22d6-4180-bcf0-0db030d6b603 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.427195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.428312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.428592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.428867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.430204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:30.431742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:30.433944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 207/410] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:30 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:30.441804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.442509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.442794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.443072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.443847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:30.444182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:30.445613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:30.450901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.459334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 204/411] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:30.474543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.603953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a3689-304d-4192-b0ca-59d15521320e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.623619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47b92-77af-4439-8ec2-ec2455c6c156 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.646765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.647638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.647950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.648232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] PATH_INFO: `/v3/groups/3cf25da79fce434eae5a2606f69f82b7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.650012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] RBAC: Authorizing `identity:get_group(group_id=3cf25da79fce434eae5a2606f69f82b7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:30.651778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:30.654095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 205/412] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:30 2022] GET /identity/v3/groups/3cf25da79fce434eae5a2606f69f82b7 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:30.660397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.679481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.680361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.680646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.680917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689/groups/e158501b03cf4944bf878f6c6793a893/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.684235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] RBAC: Authorizing `identity:create_grant(project_id=740d00875c1549f9978dbba7e8d50689, group_id=e158501b03cf4944bf878f6c6793a893, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:30.686047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:30.707996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 208/413] 10.222.0.99 () {58 vars in 1442 bytes} [Fri May 13 14:40:30 2022] PUT /identity/v3/projects/740d00875c1549f9978dbba7e8d50689/groups/e158501b03cf4944bf878f6c6793a893/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:30.792226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c831-0d6d-4a3f-9563-0f5a7995da59 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:30.835030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeba34d-039a-4dee-856b-ad31b2ec20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:30.835969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba34d-039a-4dee-856b-ad31b2ec20a7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:30.836339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba34d-039a-4dee-856b-ad31b2ec20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:30.836616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeba34d-039a-4dee-856b-ad31b2ec20a7 None admin] PATH_INFO: `/v3/projects/874372a810af4de2a4ad12d67714243a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:30.837944 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeba34d-039a-4dee-856b-ad31b2ec20a7 None admin] RBAC: Authorizing `identity:get_project(project_id=874372a810af4de2a4ad12d67714243a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:30.839433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeba34d-039a-4dee-856b-ad31b2ec20a7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:30.842834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 206/414] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:30 2022] GET /identity/v3/projects/874372a810af4de2a4ad12d67714243a => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:30.847948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:30.988013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6e85b-83b7-4cf7-9544-a48af27d3498 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:31.021103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2308a-9f48-4d24-9ba6-bd9e29e8ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:31.021996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2308a-9f48-4d24-9ba6-bd9e29e8ca8b None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.022277 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2308a-9f48-4d24-9ba6-bd9e29e8ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.022549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2308a-9f48-4d24-9ba6-bd9e29e8ca8b None admin] PATH_INFO: `/v3/projects/874372a810af4de2a4ad12d67714243a/groups/3cf25da79fce434eae5a2606f69f82b7/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.024538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2308a-9f48-4d24-9ba6-bd9e29e8ca8b None admin] RBAC: Authorizing `identity:create_grant(project_id=874372a810af4de2a4ad12d67714243a, group_id=3cf25da79fce434eae5a2606f69f82b7, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:31.025988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2308a-9f48-4d24-9ba6-bd9e29e8ca8b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:31.040419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 209/415] 10.222.0.99 () {58 vars in 1442 bytes} [Fri May 13 14:40:30 2022] PUT /identity/v3/projects/874372a810af4de2a4ad12d67714243a/groups/3cf25da79fce434eae5a2606f69f82b7/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:31.112960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8283-eec3-49bb-bcac-75fa63fc3a6a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.113271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8283-eec3-49bb-bcac-75fa63fc3a6a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.113518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8283-eec3-49bb-bcac-75fa63fc3a6a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.115391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 207/416] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:31.121407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9da2-8f15-4c6c-b7f6-c02c83a2f713 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.121846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9da2-8f15-4c6c-b7f6-c02c83a2f713 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.122224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9da2-8f15-4c6c-b7f6-c02c83a2f713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.145020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-fbab9da2-8f15-4c6c-b7f6-c02c83a2f713 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:31.146243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fbab9da2-8f15-4c6c-b7f6-c02c83a2f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:31.230333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 210/417] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:31.267360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8283-eec3-49bb-bcac-75fa63fc3a6a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:31.295108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c6ad-2278-41ef-8a50-1ba6ea62ed1c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.295435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c6ad-2278-41ef-8a50-1ba6ea62ed1c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.295670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722c6ad-2278-41ef-8a50-1ba6ea62ed1c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.297087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 211/418] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:31.302330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1c057-dab8-4b0e-8323-a60efe75ac20 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.302651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1c057-dab8-4b0e-8323-a60efe75ac20 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.302936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1c057-dab8-4b0e-8323-a60efe75ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.323085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-05b1c057-dab8-4b0e-8323-a60efe75ac20 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:31.324709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-05b1c057-dab8-4b0e-8323-a60efe75ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:31.406821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 212/419] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:31.437920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1c057-dab8-4b0e-8323-a60efe75ac20 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:31.448580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8283-eec3-49bb-bcac-75fa63fc3a6a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:31.524680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:31.525453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.525735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.526008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.556765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:31.558260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1c057-dab8-4b0e-8323-a60efe75ac20 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:31.564838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:31.565705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:31.566500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 208/420] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:31.576995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:31.624614 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:31.625810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.626325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.626792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.656786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:31.673604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:31.674575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:31.675402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:31.678088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 213/421] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:31.684175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc163f8-d98f-4b99-a69d-198c07603c4e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:31.684634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:31.719675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:31.720525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.720807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.721083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.723891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:31.723891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:31.723891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:31.732951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 209/422] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:31.739775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:31.847429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f6ce-f1b7-404a-8284-cc7ef86c54a7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:31.887221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:31.887928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.888215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.888515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:31.889379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:31.889687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:31.891073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:31.907949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 214/423] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:31.913358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:31.914684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195582-9121-41a8-bfaa-9872da985291 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:31.949040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:31.949697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:31.950020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:31.950300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:32.040089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:32.041605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:32.048481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bf23b-d2ec-403e-9a2e-ced41036bd94 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:32.104674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:32.105261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:32.105545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:32.105820 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:32.191231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 210/424] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:32.196730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:32.260912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:32.262711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:32.299494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8317519-4dc5-4218-bc0e-7b380dece2a9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:32.333244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:32.335917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:32.335917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:32.335917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:32.335917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:32.337477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:32.339230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 211/425] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:32 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:32.344943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:32.445221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d01f8-fa19-4e85-9a31-d625efae0f9a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:32.486096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:32.486978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:32.487262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:32.487539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:32.488840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:32.490319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:32.492306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 212/426] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:32 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:32.494023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 215/427] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:32.498404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:32.499308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:32.613856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46765049-f838-4d72-b22b-a47ec88186dc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:32.647982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:32.648651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:32.648934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:32.649210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:32.650049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=41cd21a482424d49974c940f0f74a43f) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:32.650358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:32.651813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:32.658323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 213/428] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:32 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:32.734222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810c386-41ea-4d08-a88b-8e0c06fd05cf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:32.782186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:32.783068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:32.783347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:32.783614 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] PATH_INFO: `/v3/projects/41cd21a482424d49974c940f0f74a43f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:32.784872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] RBAC: Authorizing `identity:get_project(project_id=41cd21a482424d49974c940f0f74a43f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:32.786332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:32.788458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 216/429] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:32 2022] GET /identity/v3/projects/41cd21a482424d49974c940f0f74a43f => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:32.793684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:32.923206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299dcc4-f1a7-4bc9-bed4-116d6838342a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:32.956722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97029f15-e88a-452c-9fe7-b8ddbb355f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:32.957591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029f15-e88a-452c-9fe7-b8ddbb355f34 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:32.957872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029f15-e88a-452c-9fe7-b8ddbb355f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:32.958150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029f15-e88a-452c-9fe7-b8ddbb355f34 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:32.959318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97029f15-e88a-452c-9fe7-b8ddbb355f34 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:32.960926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97029f15-e88a-452c-9fe7-b8ddbb355f34 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:32.962852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 214/430] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:32 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:32.968614 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:33.023502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a3bd2-2f7f-44ba-b090-630d51ecf656 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.023795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a3bd2-2f7f-44ba-b090-630d51ecf656 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.023999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a3bd2-2f7f-44ba-b090-630d51ecf656 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.025525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 215/431] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:33.031031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad259e-fc27-41f2-b103-39d4c52313ed None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.031579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad259e-fc27-41f2-b103-39d4c52313ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.031943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad259e-fc27-41f2-b103-39d4c52313ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.048921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e7ad259e-fc27-41f2-b103-39d4c52313ed None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:33.050531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e7ad259e-fc27-41f2-b103-39d4c52313ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:33.091320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ee0d9-4d63-4dd8-86f8-2e5a17d57cdc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:33.134275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 216/432] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:33.140165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:33.140849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.141136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.141417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.142267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=41cd21a482424d49974c940f0f74a43f) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:33.142583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:33.144057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:33.150766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 217/433] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:32 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=41cd21a482424d49974c940f0f74a43f&role.id=926ac669ff214536b6ec0876b5669dbc => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:33.158546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad259e-fc27-41f2-b103-39d4c52313ed None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:33.271894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad259e-fc27-41f2-b103-39d4c52313ed None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:33.312667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:33.313887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.314363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.314861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.328207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:33.338633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:33.339664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:33.340505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:33.349742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 217/434] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:33.351706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:33.458529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64871-0231-413e-96ea-3d5875f5f461 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:33.499348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a119b-cce7-4543-b7fb-01711284e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:33.500155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a119b-cce7-4543-b7fb-01711284e703 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.500339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a119b-cce7-4543-b7fb-01711284e703 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.500612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a119b-cce7-4543-b7fb-01711284e703 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.501370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a119b-cce7-4543-b7fb-01711284e703 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:33.501676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a119b-cce7-4543-b7fb-01711284e703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:33.503060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a119b-cce7-4543-b7fb-01711284e703 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:33.515978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 218/435] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:33.521027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:33.572882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c100f-0c9d-43be-a356-f6bffc8d44a4 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.573163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c100f-0c9d-43be-a356-f6bffc8d44a4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.573434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c100f-0c9d-43be-a356-f6bffc8d44a4 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.574857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 219/436] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:33.581117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893927-cfdc-4f15-a7dc-ab500c69354e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.581404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893927-cfdc-4f15-a7dc-ab500c69354e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.581683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893927-cfdc-4f15-a7dc-ab500c69354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.599666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-27893927-cfdc-4f15-a7dc-ab500c69354e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:33.601175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-27893927-cfdc-4f15-a7dc-ab500c69354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:33.641429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb15de5-6380-4f59-9d8c-0c120756e33b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:33.683031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae08957-1821-41ec-87eb-cf1eb25e145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:33.684202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae08957-1821-41ec-87eb-cf1eb25e145b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.684705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae08957-1821-41ec-87eb-cf1eb25e145b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.685205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae08957-1821-41ec-87eb-cf1eb25e145b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.687498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 220/437] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:33.710190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27893927-cfdc-4f15-a7dc-ab500c69354e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:33.773128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae08957-1821-41ec-87eb-cf1eb25e145b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:33.775109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae08957-1821-41ec-87eb-cf1eb25e145b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:33.824176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27893927-cfdc-4f15-a7dc-ab500c69354e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:33.855975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a289-da2e-4466-abe1-a1552bacac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:33.856770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a289-da2e-4466-abe1-a1552bacac71 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.857051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a289-da2e-4466-abe1-a1552bacac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.857377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a289-da2e-4466-abe1-a1552bacac71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.866916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35a289-da2e-4466-abe1-a1552bacac71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cb35a289-da2e-4466-abe1-a1552bacac71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:33.874551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:33.875413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:33.876609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 221/438] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:33.877436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fad452-171e-48f4-9feb-81c175339365 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.877436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fad452-171e-48f4-9feb-81c175339365 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.877577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fad452-171e-48f4-9feb-81c175339365 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.878751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 222/439] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:33.881488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fad452-171e-48f4-9feb-81c175339365 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:33.887019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 218/440] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:40:33.887019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a4e1e-2e04-47bc-b6da-b29c0cf28a60 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:33.887019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a4e1e-2e04-47bc-b6da-b29c0cf28a60 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:33.887019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a4e1e-2e04-47bc-b6da-b29c0cf28a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:33.900932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e44a4e1e-2e04-47bc-b6da-b29c0cf28a60 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:33.902124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e44a4e1e-2e04-47bc-b6da-b29c0cf28a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:33.965926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 219/441] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:33.966768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a4e1e-2e04-47bc-b6da-b29c0cf28a60 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:33.980408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fad452-171e-48f4-9feb-81c175339365 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.014349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.015014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.015298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.015572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.016371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:34.016678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.018062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.026369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 223/442] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:40:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:34.031198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.070206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a4e1e-2e04-47bc-b6da-b29c0cf28a60 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.109335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439174d9-153b-45f6-8699-249216293a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.110091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439174d9-153b-45f6-8699-249216293a50 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.110387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439174d9-153b-45f6-8699-249216293a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.110659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439174d9-153b-45f6-8699-249216293a50 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.111830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439174d9-153b-45f6-8699-249216293a50 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.113332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439174d9-153b-45f6-8699-249216293a50 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.114996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 220/443] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:33 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:34.115845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439174d9-153b-45f6-8699-249216293a50 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.131822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0fed1-d4e6-4010-a052-bddaf3b9fc37 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.163891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.164696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.164972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.165249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.176292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:34.183888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:34.184785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:34.185580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 224/444] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:34.186690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.211743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439174d9-153b-45f6-8699-249216293a50 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.245659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.246298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.246562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.246825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.281133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29d23-f96c-439c-b643-11a1c0530281 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.311496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.312802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.313679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.313963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.314233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.314792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.315422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.316866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.318645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 225/445] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:34.319286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.411212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 221/446] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:34.412009 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.416129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7fbf-894f-4733-bc4f-649b02ad4a21 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.448752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.449418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.449701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.449978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.450721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:34.451124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.452688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.460569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 226/447] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:34.461325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.510813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdad539-2a13-4831-953c-07f40c91a1e1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.541020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.541753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.542035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.542309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.543137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=740d00875c1549f9978dbba7e8d50689) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:34.543448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.544907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.550836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 222/448] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=926ac669ff214536b6ec0876b5669dbc => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:34.552746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.561942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8efb50-329e-4eeb-b126-6c32fbbc26d3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.603562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.604873 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.605153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.605696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] PATH_INFO: `/v3/projects/740d00875c1549f9978dbba7e8d50689` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.607341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=740d00875c1549f9978dbba7e8d50689)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.609577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.616884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 227/449] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/projects/740d00875c1549f9978dbba7e8d50689 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:34.618035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.660578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79cc9e-ecdb-4cc5-a7ff-f1467ca8269d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.695210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.695924 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.696188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.696468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.728215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d12aa6-1078-4253-959d-eb29b00bbbb6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.770649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.770861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.770861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.770861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.771160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.771233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] PATH_INFO: `/v3/groups/e158501b03cf4944bf878f6c6793a893` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.772021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] RBAC: Authorizing `identity:get_group(group_id=e158501b03cf4944bf878f6c6793a893)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.773462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.775401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 228/450] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/groups/e158501b03cf4944bf878f6c6793a893 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:34.781156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.867455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 223/451] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:34.873744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:34.874185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3246d5f-71d2-4a71-908a-42a527da0b57 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:34.907029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:34.907669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:34.907977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:34.908250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:34.909074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] RBAC: Adding query filter params (group.id=e158501b03cf4944bf878f6c6793a893, role.id=b66b87740a8d4d3d9283fa1b8e45e2f3, scope.project.id=740d00875c1549f9978dbba7e8d50689) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:34.909384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:34.910818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:34.916636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 229/452] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/role_assignments?group.id=e158501b03cf4944bf878f6c6793a893&scope.project.id=740d00875c1549f9978dbba7e8d50689&role.id=b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:34.971688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7714ee9-01b5-496d-a950-cafed91d0e6b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:35.008979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:35.009850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:35.010135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:35.010400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] PATH_INFO: `/v3/projects/874372a810af4de2a4ad12d67714243a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:35.011677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] RBAC: Authorizing `identity:get_project(project_id=874372a810af4de2a4ad12d67714243a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:35.013195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:35.015149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 224/453] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:40:34 2022] GET /identity/v3/projects/874372a810af4de2a4ad12d67714243a => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:35.021036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:35.128911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc082-3109-442e-a7b7-7df337ef265c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:35.162630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850ca2a-449b-4f58-8ec8-9e6d3546f661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:35.163495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ca2a-449b-4f58-8ec8-9e6d3546f661 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:35.163776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ca2a-449b-4f58-8ec8-9e6d3546f661 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:35.164083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ca2a-449b-4f58-8ec8-9e6d3546f661 None admin] PATH_INFO: `/v3/groups/3cf25da79fce434eae5a2606f69f82b7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:35.165261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850ca2a-449b-4f58-8ec8-9e6d3546f661 None admin] RBAC: Authorizing `identity:get_group(group_id=3cf25da79fce434eae5a2606f69f82b7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:35.166682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850ca2a-449b-4f58-8ec8-9e6d3546f661 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:35.168656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 230/454] 10.222.0.99 () {56 vars in 1180 bytes} [Fri May 13 14:40:35 2022] GET /identity/v3/groups/3cf25da79fce434eae5a2606f69f82b7 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:35.174618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:35.273698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb09a9-6eb6-4136-87eb-072779d3d058 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:35.308121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbb9ae-f5c8-4faa-928e-ed00d65d8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:35.308781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb9ae-f5c8-4faa-928e-ed00d65d8a3b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:35.309058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb9ae-f5c8-4faa-928e-ed00d65d8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:35.309324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb9ae-f5c8-4faa-928e-ed00d65d8a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:35.310175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbb9ae-f5c8-4faa-928e-ed00d65d8a3b None admin] RBAC: Adding query filter params (group.id=3cf25da79fce434eae5a2606f69f82b7, role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=874372a810af4de2a4ad12d67714243a) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:35.310782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbb9ae-f5c8-4faa-928e-ed00d65d8a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:35.312251 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbb9ae-f5c8-4faa-928e-ed00d65d8a3b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:35.318573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 225/455] 10.222.0.99 () {56 vars in 1376 bytes} [Fri May 13 14:40:35 2022] GET /identity/v3/role_assignments?group.id=3cf25da79fce434eae5a2606f69f82b7&scope.project.id=874372a810af4de2a4ad12d67714243a&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:37.903678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b255-73b9-48b5-b4db-d155641fccfd None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:37.904266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b255-73b9-48b5-b4db-d155641fccfd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:37.904381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b255-73b9-48b5-b4db-d155641fccfd None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:37.906289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 231/456] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:37.911421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72d43-7504-4966-8682-5a649b5b7e63 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:37.912262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72d43-7504-4966-8682-5a649b5b7e63 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:37.912727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72d43-7504-4966-8682-5a649b5b7e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:37.929911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fba72d43-7504-4966-8682-5a649b5b7e63 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:37.931413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fba72d43-7504-4966-8682-5a649b5b7e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:37.998010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 226/457] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:38.033146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b255-73b9-48b5-b4db-d155641fccfd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:38.158497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b255-73b9-48b5-b4db-d155641fccfd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:38.192765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d80e9-06c6-4df3-a2cb-0e9532f90a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:38.193597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d80e9-06c6-4df3-a2cb-0e9532f90a58 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.193877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d80e9-06c6-4df3-a2cb-0e9532f90a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.194148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d80e9-06c6-4df3-a2cb-0e9532f90a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.206070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d80e9-06c6-4df3-a2cb-0e9532f90a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:38.207546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d80e9-06c6-4df3-a2cb-0e9532f90a58 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-538d80e9-06c6-4df3-a2cb-0e9532f90a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:38.234969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:38.235923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:38.237206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:38.237206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:38.237206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:38.237206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:38.237206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 232/458] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:38.242457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72d43-7504-4966-8682-5a649b5b7e63 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:38.361233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72d43-7504-4966-8682-5a649b5b7e63 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:38.395723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0a5b-86e8-433c-93ed-6417c21f6618 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.396343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:38.396652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0a5b-86e8-433c-93ed-6417c21f6618 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.397021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.397298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.397527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0a5b-86e8-433c-93ed-6417c21f6618 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.397624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.398295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:38.398596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:38.400078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 233/459] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:38.400212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:38.409579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44075f-a4a0-45e6-b020-26f8379325ef None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.410248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44075f-a4a0-45e6-b020-26f8379325ef None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.410742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44075f-a4a0-45e6-b020-26f8379325ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.419757 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 227/460] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:38.424854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:38.443845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cd44075f-a4a0-45e6-b020-26f8379325ef None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:38.445400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cd44075f-a4a0-45e6-b020-26f8379325ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:38.534059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff70f-209e-4f19-8497-b5569e7a40e9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:38.567494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 234/461] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:38.569274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d436892-87d6-461f-b828-295642b8d0d3 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.569790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d436892-87d6-461f-b828-295642b8d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.570289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d436892-87d6-461f-b828-295642b8d0d3 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.575982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:38.575982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.575982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.576237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.576486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 235/462] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:38.576915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:38.578099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57340f-d3a9-4107-944a-f6b08f2f8a4a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.578368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:38.578779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57340f-d3a9-4107-944a-f6b08f2f8a4a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.579257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57340f-d3a9-4107-944a-f6b08f2f8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.597382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1d57340f-d3a9-4107-944a-f6b08f2f8a4a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:38.599564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1d57340f-d3a9-4107-944a-f6b08f2f8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:38.601001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 228/463] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:38 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:40:38.607220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:38.673641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 236/464] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:38.703226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57340f-d3a9-4107-944a-f6b08f2f8a4a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:38.732834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998d9c9-4277-4aa3-bb07-56faefd5bc13 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:38.779564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6907-044e-46d7-a711-d935648c1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:38.780437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6907-044e-46d7-a711-d935648c1d7f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.780715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6907-044e-46d7-a711-d935648c1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.780981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6907-044e-46d7-a711-d935648c1d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.794716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e6907-044e-46d7-a711-d935648c1d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:38.796264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e6907-044e-46d7-a711-d935648c1d7f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:38.813423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57340f-d3a9-4107-944a-f6b08f2f8a4a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ef1e6907-044e-46d7-a711-d935648c1d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:38.820229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:38.821493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:38.822383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:38.822383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:38.822383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:38.822383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:38.822383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 229/465] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:38.823348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18527d8-fcaf-43a7-acbe-3280106f8b2a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.828247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18527d8-fcaf-43a7-acbe-3280106f8b2a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.829397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18527d8-fcaf-43a7-acbe-3280106f8b2a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.833088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 230/466] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:38.834334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18527d8-fcaf-43a7-acbe-3280106f8b2a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:38.863627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6be3e-cb5c-479e-9175-c447da8aec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:38.864064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6be3e-cb5c-479e-9175-c447da8aec2c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.864157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6be3e-cb5c-479e-9175-c447da8aec2c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.865064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6be3e-cb5c-479e-9175-c447da8aec2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.875810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6be3e-cb5c-479e-9175-c447da8aec2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:38.877708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6be3e-cb5c-479e-9175-c447da8aec2c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9df6be3e-cb5c-479e-9175-c447da8aec2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:38.902006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:38.902880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:38.903804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:38.903804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:38.903804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:38.903804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:38.906975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 237/467] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:38.906975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7f578-6a4a-4a6a-946d-1123dcbe921e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:38.907274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7f578-6a4a-4a6a-946d-1123dcbe921e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:38.909094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7f578-6a4a-4a6a-946d-1123dcbe921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:38.925876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-30e7f578-6a4a-4a6a-946d-1123dcbe921e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:38.927029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-30e7f578-6a4a-4a6a-946d-1123dcbe921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:38.966537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18527d8-fcaf-43a7-acbe-3280106f8b2a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:38.994359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 238/468] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:38.995238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7f578-6a4a-4a6a-946d-1123dcbe921e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:39.000535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.001212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.001493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.001772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.002505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:39.002814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.005013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.017907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 231/469] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:39.023118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:39.117437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7f578-6a4a-4a6a-946d-1123dcbe921e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:39.120832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2a7e-374d-48ec-8121-81b2263f0c9b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:39.154544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.155159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.155305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.155501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.155779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.155890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.156138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.156415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.156566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:39.156838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.157117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.158245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.158556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.169941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 239/470] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:39.171055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:39.181992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 232/471] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:39 2022] POST /identity/v3/users => generated 248 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:40:39.182875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:39.295246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb4c1-6ae6-4bc2-b1e3-3d46c68d5b41 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:39.340986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.341847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.342132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.342407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.346963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.348504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.391578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 233/472] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:39 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:39.402231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac78038-44e1-4d3f-a4c4-e8ac04317c42 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:39.442465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd7c9b-b126-4611-b28e-bbc750ba5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.443212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7c9b-b126-4611-b28e-bbc750ba5e7f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.443501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7c9b-b126-4611-b28e-bbc750ba5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.443771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7c9b-b126-4611-b28e-bbc750ba5e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.456037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd7c9b-b126-4611-b28e-bbc750ba5e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.457591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd7c9b-b126-4611-b28e-bbc750ba5e7f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5ffd7c9b-b126-4611-b28e-bbc750ba5e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:39.476930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:39.477855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:39.479129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:39.479129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:39.479129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:39.479129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:39.479129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 240/473] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:39.484460 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:39.594260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a11b-82d6-468c-bba2-9417e847f006 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:39.619677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d6d8-060b-4f3c-a245-9ba8dbf5f401 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.620016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d6d8-060b-4f3c-a245-9ba8dbf5f401 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.620257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d6d8-060b-4f3c-a245-9ba8dbf5f401 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.621896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 241/474] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:39.628087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dca6e-5d85-4685-a720-fb0d2dd0e749 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.628373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dca6e-5d85-4685-a720-fb0d2dd0e749 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.628652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dca6e-5d85-4685-a720-fb0d2dd0e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.635504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.636235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.636519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.636794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.637528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:39.637834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.639976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.652357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 234/475] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:39.655893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c43dca6e-5d85-4685-a720-fb0d2dd0e749 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:39.657248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c43dca6e-5d85-4685-a720-fb0d2dd0e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:39.658099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:39.735245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 242/476] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:39.758922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dca6e-5d85-4685-a720-fb0d2dd0e749 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:39.778575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36364c6e-33f6-4215-8bee-609733e0af96 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:39.829665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.831075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.831599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.832077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.833085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.835197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.874784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 235/477] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:39 2022] POST /identity/v3/users => generated 249 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:39.886704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dca6e-5d85-4685-a720-fb0d2dd0e749 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:39.938339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:39.939034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:39.939315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:39.939593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:39.940399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:39.941804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:39.953645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.sql.core [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 14:40:39.953645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 14:40:39.953645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [parameters: {'id': 'a954621d3bfa4a87a5ded74d5ba2ee76', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 14:40:39.953645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80255) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application conn.query(q) May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result.read() May 13 14:40:39.977013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return ref.to_dict() May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:40:39.978114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application next(self.gen) May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application yield resource May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application next(self.gen) May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.session.rollback() May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.force_reraise() May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise self.value May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application session.commit() May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 14:40:39.979417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._prepare_impl() May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.session.flush() May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._flush(objects) May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application compat.raise_( May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application flush_context.execute() May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rec.execute(self) May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 14:40:39.981354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:40:39.983191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application conn.query(q) May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result.read() May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:40:39.993261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [parameters: {'id': 'a954621d3bfa4a87a5ded74d5ba2ee76', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:39.994935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 14:40:39.996758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:39.998751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 243/478] 10.222.0.99 () {60 vars in 1131 bytes} [Fri May 13 14:40:39 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:39.998886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:40.100558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449f8b1-d099-4a62-8e1d-f21f25e4e6cc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:40.148792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac79672-d510-4953-a0f4-24d521de2ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:40.149645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac79672-d510-4953-a0f4-24d521de2ceb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:40.149927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac79672-d510-4953-a0f4-24d521de2ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:40.150202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac79672-d510-4953-a0f4-24d521de2ceb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:40.164620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac79672-d510-4953-a0f4-24d521de2ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-aac79672-d510-4953-a0f4-24d521de2ceb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:40.173353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:40.175451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:40.177405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 236/479] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:40:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:40.185259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:40.301064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcf890-a45b-4782-89ff-5898d35a8c1b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:40.338247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f419675-a637-4b25-8b3d-5051be449696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:40.338934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f419675-a637-4b25-8b3d-5051be449696 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:40.339214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f419675-a637-4b25-8b3d-5051be449696 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:40.339490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f419675-a637-4b25-8b3d-5051be449696 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:40.340277 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f419675-a637-4b25-8b3d-5051be449696 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:40.340581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f419675-a637-4b25-8b3d-5051be449696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:40.342073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f419675-a637-4b25-8b3d-5051be449696 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:40.351171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 244/480] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:41.320595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944d61-6006-4e2b-a08d-3e8bc55b79a0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:41.321148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944d61-6006-4e2b-a08d-3e8bc55b79a0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:41.321148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944d61-6006-4e2b-a08d-3e8bc55b79a0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:41.322769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 237/481] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:41.328523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a4c6e-29ab-42d3-b464-c84f70682fb2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:41.328952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a4c6e-29ab-42d3-b464-c84f70682fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:41.329152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a4c6e-29ab-42d3-b464-c84f70682fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:41.345939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-471a4c6e-29ab-42d3-b464-c84f70682fb2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:41.347118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-471a4c6e-29ab-42d3-b464-c84f70682fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:41.423284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 245/482] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:41.446595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4944d61-6006-4e2b-a08d-3e8bc55b79a0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:41.549579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4944d61-6006-4e2b-a08d-3e8bc55b79a0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:41.582564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:41.583291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:41.583574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:41.583850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:41.594012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:41.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:41.602904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:41.603698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 238/483] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:41.609415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a4c6e-29ab-42d3-b464-c84f70682fb2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:41.730800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a4c6e-29ab-42d3-b464-c84f70682fb2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:41.780265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa6b1b-2872-4eca-a5ff-0a7c827b941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:41.781010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6b1b-2872-4eca-a5ff-0a7c827b941f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:41.781300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6b1b-2872-4eca-a5ff-0a7c827b941f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:41.781577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa6b1b-2872-4eca-a5ff-0a7c827b941f None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:41.782358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6b1b-2872-4eca-a5ff-0a7c827b941f None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:41.782730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6b1b-2872-4eca-a5ff-0a7c827b941f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:41.784226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa6b1b-2872-4eca-a5ff-0a7c827b941f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:41.797053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 246/484] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:41.803012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:41.928463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd8655-47f3-4d7f-84a7-8614dae160d1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:41.979278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:41.980108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:41.980390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:41.980666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:41.990890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106bcda-8f6c-4f51-96f5-0b044d7e7287 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:41.991180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106bcda-8f6c-4f51-96f5-0b044d7e7287 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:41.991460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106bcda-8f6c-4f51-96f5-0b044d7e7287 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:41.991784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:41.993101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 247/485] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:41.993287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:41.998538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93bff6-acd9-4e3f-aff7-7e470f85a108 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:41.998830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93bff6-acd9-4e3f-aff7-7e470f85a108 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:41.999105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93bff6-acd9-4e3f-aff7-7e470f85a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:42.015337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:42.016282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:42.017143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:42.017143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:42.017143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:42.017143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:42.019025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 239/486] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:42.025369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.029801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4e93bff6-acd9-4e3f-aff7-7e470f85a108 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:42.036439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4e93bff6-acd9-4e3f-aff7-7e470f85a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:42.134114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 248/487] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:42.186219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93bff6-acd9-4e3f-aff7-7e470f85a108 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.227401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8e66-ee33-46ab-8929-adf13643b5b2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.275463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.276171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.276455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.276733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.277605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:42.277792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:42.279404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:42.302991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93bff6-acd9-4e3f-aff7-7e470f85a108 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.307235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 240/488] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:42.312357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.338265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1100b74-4b83-40a1-a7fb-efb80c90f674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.339848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1100b74-4b83-40a1-a7fb-efb80c90f674 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.340350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1100b74-4b83-40a1-a7fb-efb80c90f674 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.340813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1100b74-4b83-40a1-a7fb-efb80c90f674 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.351829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1100b74-4b83-40a1-a7fb-efb80c90f674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d1100b74-4b83-40a1-a7fb-efb80c90f674 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:42.360080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:42.360956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:42.361748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:42.364148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 249/489] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:42.365571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fcbb8-93cb-44f0-ba08-d3df4b461fca None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.366046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fcbb8-93cb-44f0-ba08-d3df4b461fca None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.366525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fcbb8-93cb-44f0-ba08-d3df4b461fca None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.368316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 250/490] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:42.373385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fcbb8-93cb-44f0-ba08-d3df4b461fca None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.425705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41f887-e5fe-4d7f-979c-8c6aa761f04a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.460744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed050c-2b28-4248-b07a-040fc0e94c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.461912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed050c-2b28-4248-b07a-040fc0e94c3c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.462389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed050c-2b28-4248-b07a-040fc0e94c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.462853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed050c-2b28-4248-b07a-040fc0e94c3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.476081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fcbb8-93cb-44f0-ba08-d3df4b461fca None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.476823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed050c-2b28-4248-b07a-040fc0e94c3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:42.478598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed050c-2b28-4248-b07a-040fc0e94c3c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6bed050c-2b28-4248-b07a-040fc0e94c3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:42.495670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:42.496665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:40:42.497619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:42.500338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 241/491] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:42.501791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0b8ae-f098-4612-b29b-14b9fdfe3d11 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.502270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0b8ae-f098-4612-b29b-14b9fdfe3d11 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.502750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0b8ae-f098-4612-b29b-14b9fdfe3d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.514306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.515013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.515291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.515560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.516339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:42.516638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:42.518014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:42.526304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9ee0b8ae-f098-4612-b29b-14b9fdfe3d11 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:42.527818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ee0b8ae-f098-4612-b29b-14b9fdfe3d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:42.531023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 251/492] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:42.531981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.596922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 242/493] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:42.598202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0b8ae-f098-4612-b29b-14b9fdfe3d11 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.652807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9b12-ce7d-462f-8c94-5fbfa3d034ed None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.686355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.687087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.687293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.687563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.688435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:42.688738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:42.690168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:42.699963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0b8ae-f098-4612-b29b-14b9fdfe3d11 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.727166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 252/494] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:42.728107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.735288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.736431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.736914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.737379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.748414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:42.750252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:42.768628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:42.769528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:42.770353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:42.770353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:42.770353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:42.770353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:42.772369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 243/495] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:42.773398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.829645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a86c6-b164-4200-80af-3ad82dc174c5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.864910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.865704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.865983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.866254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.877910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:42.878417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1dcb-4acb-486e-9dae-6b9444e2efe1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:42.885631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:42.886588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:42.887399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 253/496] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:42.892559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:42.917624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fad1e-de76-4242-8685-8ac36f9c93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:42.918738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fad1e-de76-4242-8685-8ac36f9c93ad None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:42.919452 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fad1e-de76-4242-8685-8ac36f9c93ad None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:42.920151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fad1e-de76-4242-8685-8ac36f9c93ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:42.993959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5177c-0366-4e02-83bb-2dc9dfe34b06 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:42.995557 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fad1e-de76-4242-8685-8ac36f9c93ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:42.997417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fad1e-de76-4242-8685-8ac36f9c93ad None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.026759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.027428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.027725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.028008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.028917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:43.029092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.030671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.042781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 254/497] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:43.043682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.102472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 244/498] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:43.103928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee372cd9-3a2e-466f-9b4e-a50b44a1f668 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.104217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee372cd9-3a2e-466f-9b4e-a50b44a1f668 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.104492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee372cd9-3a2e-466f-9b4e-a50b44a1f668 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.105908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 245/499] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:43.110873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee372cd9-3a2e-466f-9b4e-a50b44a1f668 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.138701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec58db-47d6-4f3b-9d3a-5d1a9672ad10 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.170272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.170947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.171232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.171509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.172294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:43.172607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.173999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.182032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 255/500] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:43.182829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.204584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee372cd9-3a2e-466f-9b4e-a50b44a1f668 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.236276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91d757-d107-47e8-87fa-40994002a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.237084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d757-d107-47e8-87fa-40994002a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.237369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d757-d107-47e8-87fa-40994002a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.237643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d757-d107-47e8-87fa-40994002a3a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.244523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91d757-d107-47e8-87fa-40994002a3a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.245913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91d757-d107-47e8-87fa-40994002a3a2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ae91d757-d107-47e8-87fa-40994002a3a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:43.260330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:43.261229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:40:43.262110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:43.264012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 246/501] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:43.265475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16264-e954-4e22-ab87-dbfb5da7ee8b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.265748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16264-e954-4e22-ab87-dbfb5da7ee8b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.266118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16264-e954-4e22-ab87-dbfb5da7ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.281381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065d729-8adb-4063-9baf-cfbf04647e72 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.282403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d8c16264-e954-4e22-ab87-dbfb5da7ee8b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:43.283578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d8c16264-e954-4e22-ab87-dbfb5da7ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:43.315360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.316199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.316480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.316750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.328655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.330125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.345519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 247/502] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:43.346772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b50e6-e4d9-45bc-9e55-431c933c2ea7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:43.346960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:43.348115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:43.353935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:43.353935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:43.353935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:43.353935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:43.354146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b50e6-e4d9-45bc-9e55-431c933c2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.354146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b50e6-e4d9-45bc-9e55-431c933c2ea7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.354275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 256/503] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:43.354341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 248/504] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:43.354341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b50e6-e4d9-45bc-9e55-431c933c2ea7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.354455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.454686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63e79-8331-4add-a93b-7b6db88a76b0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.459791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b50e6-e4d9-45bc-9e55-431c933c2ea7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.489805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.490608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.490893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.491168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.495144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576232e-fa01-4f9d-b150-49dfa37e1731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.496066 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576232e-fa01-4f9d-b150-49dfa37e1731 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.496349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576232e-fa01-4f9d-b150-49dfa37e1731 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.496625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576232e-fa01-4f9d-b150-49dfa37e1731 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.498023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576232e-fa01-4f9d-b150-49dfa37e1731 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:43.498337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576232e-fa01-4f9d-b150-49dfa37e1731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.499788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576232e-fa01-4f9d-b150-49dfa37e1731 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.501696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.503120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:43.521833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:43.522831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:43.523772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:43.523772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:43.523772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:43.523772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:43.523772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 257/505] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:43.524229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.536889 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 249/506] 10.222.0.99 () {56 vars in 1137 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:43.538245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fcac5-96a2-472d-9f7c-a10812219c6b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.538537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fcac5-96a2-472d-9f7c-a10812219c6b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.538812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fcac5-96a2-472d-9f7c-a10812219c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.556220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-081fcac5-96a2-472d-9f7c-a10812219c6b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:43.557419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-081fcac5-96a2-472d-9f7c-a10812219c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:43.621463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 250/507] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:43.622413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fcac5-96a2-472d-9f7c-a10812219c6b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.625264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df60e74-4fd5-447f-9ac8-88574a332a3a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.657969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.658633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.658915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.659189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.659936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:43.660244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.661608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.673008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 258/508] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:43.673800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.716439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fcac5-96a2-472d-9f7c-a10812219c6b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.749783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.750490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.750756 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.751021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.760758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.762219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.768931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31aba8-e097-4632-9c2d-e4fcd65fc66c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:43.779098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:43.780048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:43.780894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:43.780894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:43.780894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:43.780894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:43.780894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 251/509] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:43.781169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.803305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.804036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.804317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.804584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.805308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:43.805611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.807040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:43.819087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 259/510] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:43.819905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.875434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8acc0-6670-46b1-b80c-09a954311eba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.908921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.909561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.909836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.910106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.916200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b72402-6d05-44a2-8894-5d6ed2f0fe8a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:43.947862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:43.948689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:43.948964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:43.949261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:43.959169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:43.967175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:43.968121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:43.968921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 260/511] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:43.969558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:43.976937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:43.978429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.069330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce91a10-4e2a-490a-b938-67b9ad41ff52 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.069509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 252/512] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:44.070353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.103224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.104054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.104338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.104611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.111139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.112635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:44.127050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:44.127887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:44.128731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 261/513] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:44.129212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.169361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d193c-c29e-4e2f-abce-418eebb9c9bc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.211598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.212290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.212569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.212820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.213568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:44.213872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.215273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.219811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fc057-0d35-437f-83b3-2264b54b85d5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.227222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 253/514] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:44.228749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.256344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.257185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.257447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.257724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.264901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.266354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:44.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:44.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:44.284683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 262/515] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:44.285237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.337270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3993-89bf-4bc5-ad77-d8790339198f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.373730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.374398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.374671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.374943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.375688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:44.376030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.377413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.383420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e818643-dbb1-4280-8069-f0e32ebb1b24 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.385124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 254/516] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:44.385896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.417707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.418504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.418781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.419108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.428792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.430261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:44.447183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:44.448075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:44.448936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:44.448936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:44.448936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:44.448936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:44.448936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 263/517] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:44.449190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.488564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611f31-ff21-4716-a38c-a5d7e0f8f8ab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.521182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.521914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.522196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.522503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.523274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:44.523579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.525055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.542459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 255/518] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:44.543260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.548182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8bb4-c50c-48a1-833b-b393ff0c4212 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.581689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.582361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.582645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.582918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.583657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.585121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.605006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 264/519] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:40:44 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:40:44.605765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.648052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ca1c4-9bdb-4114-87d3-9d57d57dccf8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.687530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.687749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.688054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.688253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.689060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:44.689373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.690858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.714649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 256/520] 10.222.0.99 () {56 vars in 1137 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:44.714649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.720195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42995f8-a5fd-43c9-bb9a-044ed1d262c7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.754543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.755362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.755645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.755948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.768136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.769589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:44.787264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:44.788495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:44.792860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:44.792860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:44.792860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:44.792860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:44.792860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 265/521] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:44.792860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.823500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d535d0-1373-46fa-81a8-d716cf904c32 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.861374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.861950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.862231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.862504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.863221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:44.863523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.864949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.876740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 257/522] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:44.879925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.888965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba8df2-de1b-44b2-aa4a-5442d062c7b3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:44.922011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:44.922670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:44.922971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:44.923222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:44.924096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=38f74d30b6da44cb8f60e87f44da4ff5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:44.924429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:44.925832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:44.931347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 266/523] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/role_assignments?user.id=38f74d30b6da44cb8f60e87f44da4ff5&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:44.932209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:44.990746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a5a9-0100-4247-8e99-b0927eca9e72 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.026450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.027557 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.028062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.028642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.038638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c05c-2d66-4237-8d83-52ed5ffea4b6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.074387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.075064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.075372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.075711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.076482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:45.076787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.078198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.091370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 267/524] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:45.092311 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.111103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.112706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.209243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da70fa-8242-4672-b13a-297dad5a2084 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.216994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 258/525] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:45.217909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.256481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.257356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.257678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.258001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.267446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.269386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:45.284203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:45.285051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:45.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 268/526] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:45.286323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.333147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b829bc0-c330-4db8-a139-7e9e513a46c2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.369590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.370370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.370650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.370964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.378361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.379906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.390434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e495d-5e76-4a34-b32c-2196cc6775e8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:45.394517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:45.396931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 259/527] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:45.399103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.429384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.430187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.430471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.430747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.443668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.445324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:45.462778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:45.464812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:45.467154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:45.467154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:45.467154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:45.467154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:45.467154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 269/528] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:45.467154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.505463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136e6d0-82b4-4963-a048-d1b1027d957e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.539846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.540642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.540922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.541193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.542033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:45.542344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.543845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.555807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 260/529] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:45.561869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.576230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9508e-2b31-4166-bb00-1101587df24f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.610770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.611447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.611728 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.612148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.613032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:45.613345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.614794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.637195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 270/530] 10.222.0.99 () {56 vars in 1139 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:45.638069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.671583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815574-26c0-453a-98f3-280f2e3156f5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.705568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.706251 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.706533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.706811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.707538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:45.707847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.709280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.722059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 261/531] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:45.722920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.741711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fb37b-e54c-45f2-8e24-18260fb41e04 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.776087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.776754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.777038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.777368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.778284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=e156813f50bf4f1193ecb279fad65b04) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:45.778624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.780093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.786258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 271/532] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/role_assignments?user.id=e156813f50bf4f1193ecb279fad65b04&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:45.787088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:45.864171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2bc47-322f-40e6-b094-42e25ea76498 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.893904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd9c76-79a4-4511-b65e-a834112b577a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:45.936627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.937577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.937859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.938133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.948691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:45.950884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:45.951547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:45.951825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:45.952122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:45.953427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:45.985482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:45.987518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:45.989572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:46.000016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 272/533] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:46.016953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:46.072880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:46.074362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:46.193142 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d00ff-86ec-4b90-a881-e58f0488323f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:46.227885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 262/534] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:46.228437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:46.229312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:46.229778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:46.230238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:46.231224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:46.231756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:46.233395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:46.233498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:46.251902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 273/535] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:46.260860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:46.396398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10343b3-4cc8-4065-969b-191895eca571 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:46.444320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:46.445683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:46.446270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:46.446750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:46.457074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:46.457351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d262-d00c-49b7-90e9-99c45f97ac4b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:46.459323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:46.477186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:46.478070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:46.478985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:46.478985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:46.478985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:46.478985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:46.481200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 263/536] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:46.489079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:46.528981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:46.529647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:46.529923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:46.530189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:46.531029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=1e1525affb11454d977ac931c4feb822) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:46.531333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:46.532817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:46.551439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 274/537] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:46 2022] GET /identity/v3/role_assignments?user.id=1e1525affb11454d977ac931c4feb822&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:46.619346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ed5a8-234d-45d2-943a-a9308b0a35dd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:46.654317 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:46.654995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:46.655274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:46.655548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:46.656304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:46.656610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:46.657991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:46.670169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 264/538] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:46.675530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:46.780067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6e83-bd0e-480b-beb5-e5e117c27b4b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:46.815223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:46.816065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:46.816351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:46.816652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:46.824067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:46.825610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:46.842213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:46.844335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:46.846467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 275/539] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:46.849542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:46.962999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a62b9-ef7e-4cb2-afc0-5889dc6abeeb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:47.011371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f80157-c50b-4e3b-a742-01cc6305ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:47.012064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80157-c50b-4e3b-a742-01cc6305ec04 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.012347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80157-c50b-4e3b-a742-01cc6305ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.012652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80157-c50b-4e3b-a742-01cc6305ec04 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.013443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80157-c50b-4e3b-a742-01cc6305ec04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:47.013748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80157-c50b-4e3b-a742-01cc6305ec04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:47.015212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80157-c50b-4e3b-a742-01cc6305ec04 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:47.028045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 265/540] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:47.033676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:47.139912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28290c-073b-4de8-86bb-24b33728f330 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.139912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28290c-073b-4de8-86bb-24b33728f330 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.139912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28290c-073b-4de8-86bb-24b33728f330 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.140790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 266/541] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:47.153196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100367-1aba-40fb-bcfb-5e221d73a290 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.153492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100367-1aba-40fb-bcfb-5e221d73a290 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.153776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100367-1aba-40fb-bcfb-5e221d73a290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.170082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195ad8-4125-46a1-a0ce-23636eb9ddc5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:47.189877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8b100367-1aba-40fb-bcfb-5e221d73a290 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:47.191074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8b100367-1aba-40fb-bcfb-5e221d73a290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:47.203656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:47.204370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.204650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.204920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.205763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=81e8247739e24fcd9b067f1aa1cb9b79) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:47.206067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:47.207538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:47.214171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 276/542] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:47 2022] GET /identity/v3/role_assignments?user.id=81e8247739e24fcd9b067f1aa1cb9b79&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:47.303979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 267/543] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:47.349946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:47.431498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678004f-e020-4480-9208-72bf402bd402 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.431799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678004f-e020-4480-9208-72bf402bd402 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.432145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678004f-e020-4480-9208-72bf402bd402 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.433735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 268/544] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:47.439388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0cb49-3d29-4cf1-8d25-9247bdf61c38 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.439677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0cb49-3d29-4cf1-8d25-9247bdf61c38 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.439983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0cb49-3d29-4cf1-8d25-9247bdf61c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.473775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f3b0cb49-3d29-4cf1-8d25-9247bdf61c38 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:47.473775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f3b0cb49-3d29-4cf1-8d25-9247bdf61c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:47.488861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2657b-51aa-441a-8c0e-0937fd7227e3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:47.534449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:47.535682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.536179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.537336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.555355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:47.567530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:47.568473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:47.569267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:47.575968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 277/545] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:47.578212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:47.627832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 269/546] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:47.661271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0cb49-3d29-4cf1-8d25-9247bdf61c38 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:47.678285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74548-ca8b-4443-819e-9dd404093a7b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:47.712044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:47.713078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.713583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.714057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.715027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:47.715525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:47.717337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:47.730668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 278/547] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:47.732838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:47.867604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0cb49-3d29-4cf1-8d25-9247bdf61c38 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:47.905760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:47.906564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.906843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.907113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:47.913825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520c73e-52f2-4c90-83a6-781e7af3f43e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:47.931802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:47.943026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:47.943995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:47.945173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 270/548] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:47.954394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:47.982244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:47.984509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:47.984794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:47.985071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.009333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.010804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:48.050721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:48.052857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:48.054898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:48.054898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:48.054898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:48.054898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:48.054898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 279/549] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:48.061234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.090788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29caeae-5ddf-4561-a0f4-b9203a6d135f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.133912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.134512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.134789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.135057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.135809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:48.136948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.138407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.158474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 271/550] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:48.169065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.241009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8481a6-5282-46f1-94ce-70fc3b1442ee None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.300537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.301539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.302009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.302452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.303351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:48.303836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.305400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.325499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 280/551] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:48.331192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.343967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa9f5a-0c87-4907-9b41-9b93d74cfd0a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.406334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca83f28-1e88-47a7-ba0f-becb116e4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.407180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83f28-1e88-47a7-ba0f-becb116e4f67 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.407352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83f28-1e88-47a7-ba0f-becb116e4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.407601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca83f28-1e88-47a7-ba0f-becb116e4f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.418204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83f28-1e88-47a7-ba0f-becb116e4f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.420273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca83f28-1e88-47a7-ba0f-becb116e4f67 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9ca83f28-1e88-47a7-ba0f-becb116e4f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:48.438371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:48.439270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:48.440546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:48.440546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:48.440546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:48.440546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:48.442896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 272/552] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:48.449577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf335de-dadb-4a17-a6e6-bb8c987d7733 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.450204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf335de-dadb-4a17-a6e6-bb8c987d7733 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.450666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf335de-dadb-4a17-a6e6-bb8c987d7733 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.452667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 273/553] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:48.453568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf335de-dadb-4a17-a6e6-bb8c987d7733 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.465386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385c29-0b1a-40c0-9d89-b91a34522b53 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.501969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af13d0-ac4e-4791-9459-991726cee250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.502782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af13d0-ac4e-4791-9459-991726cee250 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.503059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af13d0-ac4e-4791-9459-991726cee250 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.503327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af13d0-ac4e-4791-9459-991726cee250 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.510658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af13d0-ac4e-4791-9459-991726cee250 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.511835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af13d0-ac4e-4791-9459-991726cee250 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-37af13d0-ac4e-4791-9459-991726cee250 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:48.526532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:48.527420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:48.528748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 281/554] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:48.529417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da6ca-2450-4b5d-893c-4f0c1bc6c491 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.530472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da6ca-2450-4b5d-893c-4f0c1bc6c491 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.530472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da6ca-2450-4b5d-893c-4f0c1bc6c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.546847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d85da6ca-2450-4b5d-893c-4f0c1bc6c491 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:48.548056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d85da6ca-2450-4b5d-893c-4f0c1bc6c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:48.578394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf335de-dadb-4a17-a6e6-bb8c987d7733 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.614674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.615340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.615618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.615954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.616640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:48.616941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.618537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.620536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 282/555] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:48.622107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da6ca-2450-4b5d-893c-4f0c1bc6c491 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.630903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 274/556] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:48.636361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.726855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da6ca-2450-4b5d-893c-4f0c1bc6c491 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.741983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8ca3-40c9-4fdf-a66b-dca90fd55020 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.762565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.763248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.763530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.763803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.764693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:48.765000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.766443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.776395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.777196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.777473 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.777747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.784940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 283/557] 10.222.0.99 () {56 vars in 1135 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:48.785257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:48.785790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.786945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:48.802024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:48.804302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 275/558] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:48.806655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:48.892842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b5cd9-d23e-4642-b2f4-a7c6c79fd355 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.900533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37378-83b8-42d8-a40c-02c6d067e6ad None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:48.926583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.927389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.927669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.927988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.934539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:48.935110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:48.935386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:48.935656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:48.938470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:48.946365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:48.948509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 284/559] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:48.950702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.007531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.009232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.051893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb261b-37b5-43bd-b16f-a242fcfad332 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.085899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb213-9057-458a-b172-126304316ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.086578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb213-9057-458a-b172-126304316ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.086892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb213-9057-458a-b172-126304316ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.087125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb213-9057-458a-b172-126304316ed8 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.088192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb213-9057-458a-b172-126304316ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:49.088360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb213-9057-458a-b172-126304316ed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.089800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb213-9057-458a-b172-126304316ed8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.107127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 276/560] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:49.108320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.112192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 285/561] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:40:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:49.113096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb213-9057-458a-b172-126304316ed8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.208327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761687b6-a232-4d2d-977a-0a2b9f1d549c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.214927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb213-9057-458a-b172-126304316ed8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.242655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.243656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.244125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.244582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.245484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:49.246097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.248112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.249146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.250085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.250435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.250772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.261928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.262590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 277/562] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:49.263482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.263994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:49.281585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:49.282965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:49.284012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:49.284012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:49.284012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:49.284012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:49.284012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 286/563] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:49.284012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.365248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880eff90-30d3-4367-9dee-930f20f92d8c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.385027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bcf02-2ccb-46ab-a8e2-5599752a1f25 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.407082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.408555 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.409070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.409689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.423286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.424297 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13986332-a48b-4ace-bc89-dc082a19cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.425023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.425151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986332-a48b-4ace-bc89-dc082a19cb49 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.425381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986332-a48b-4ace-bc89-dc082a19cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.425654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986332-a48b-4ace-bc89-dc082a19cb49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.436862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13986332-a48b-4ace-bc89-dc082a19cb49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.438327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13986332-a48b-4ace-bc89-dc082a19cb49 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:49.443517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:49.444553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:49.445593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:49.445593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:49.445593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:49.445593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:49.445593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 278/564] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:49.445593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-13986332-a48b-4ace-bc89-dc082a19cb49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:49.459215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:49.460298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:49.461361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:49.461361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:49.461361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:49.461361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:49.462933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 287/565] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:49.464487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09f21-bc82-42db-8c72-42cc9b68eac9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.464814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09f21-bc82-42db-8c72-42cc9b68eac9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.465095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09f21-bc82-42db-8c72-42cc9b68eac9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.466653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 288/566] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:49.468752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09f21-bc82-42db-8c72-42cc9b68eac9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.552851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba4105-3ca7-4ac5-98b4-0340d3b09de9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.584001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09f21-bc82-42db-8c72-42cc9b68eac9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.584510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.584867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.585145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.585412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.586123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:49.586421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.587789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.599699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 279/567] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:49.600370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.618794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7eb513-63dc-4e2d-b177-29c104c4e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.619457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eb513-63dc-4e2d-b177-29c104c4e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.619736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eb513-63dc-4e2d-b177-29c104c4e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.620035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7eb513-63dc-4e2d-b177-29c104c4e2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.620763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7eb513-63dc-4e2d-b177-29c104c4e2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:49.621070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7eb513-63dc-4e2d-b177-29c104c4e2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.622542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7eb513-63dc-4e2d-b177-29c104c4e2e0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.633397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 289/568] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:49.634723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dec6-fb64-4e25-98a0-57a868ef1959 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.635016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dec6-fb64-4e25-98a0-57a868ef1959 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.635293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727dec6-fb64-4e25-98a0-57a868ef1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.652412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3727dec6-fb64-4e25-98a0-57a868ef1959 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:49.653601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3727dec6-fb64-4e25-98a0-57a868ef1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:49.693343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6746c-260a-4bb5-b515-36c2e343ba3a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.717041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 290/569] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:49.718345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17bed-f809-4c45-8b04-e1e939af1019 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.718619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17bed-f809-4c45-8b04-e1e939af1019 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.718898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17bed-f809-4c45-8b04-e1e939af1019 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.723924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 291/570] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:49.723924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17bed-f809-4c45-8b04-e1e939af1019 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.729610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.730276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.730557 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.730829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.731604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:49.732102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.733499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.744812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 280/571] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:49.745533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.827270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17bed-f809-4c45-8b04-e1e939af1019 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.843083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b10f3-ad3c-4036-b8b4-4304a4f24d29 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:49.862388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c734e2c-323a-432e-baff-46781c0fd756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.863482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734e2c-323a-432e-baff-46781c0fd756 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.863763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734e2c-323a-432e-baff-46781c0fd756 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.864065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734e2c-323a-432e-baff-46781c0fd756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.870666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c734e2c-323a-432e-baff-46781c0fd756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.872251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c734e2c-323a-432e-baff-46781c0fd756 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.874643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:49.875435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.875715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.876034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.882617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:49.884111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3c734e2c-323a-432e-baff-46781c0fd756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:49.885847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:49.886726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:49.888336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 292/572] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:49.888813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f95b-1410-41b3-9bab-d724b401edec None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:49.888813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f95b-1410-41b3-9bab-d724b401edec None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:49.889010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f95b-1410-41b3-9bab-d724b401edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:49.901901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:49.902990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 281/573] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:49.908930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:49.909586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1f93f95b-1410-41b3-9bab-d724b401edec None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:49.909586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1f93f95b-1410-41b3-9bab-d724b401edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:49.969404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 293/574] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:49.970247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f95b-1410-41b3-9bab-d724b401edec None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.005495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c787e-57d2-49eb-aab0-7e495f1d080a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.038592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.039385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.039664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.039963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.050831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:50.058603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:50.059753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 282/575] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:50.060905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.069444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f95b-1410-41b3-9bab-d724b401edec None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.103071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.103807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.104119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.104399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.111475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.112952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:50.127445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:50.128454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 294/576] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:50.129404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.162412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad934c-bd8b-4d60-8b1a-7b0e2ed7482f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.194438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.195089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.195366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.195637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.196443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:50.196750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.198206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.209738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 283/577] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:50.210521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.229575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fdb63-1e96-4da7-aee8-6afdbe7d1b0c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.263668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.264422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.264716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.264990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.265801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:50.266111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.267570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.279408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 295/578] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:50.280165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.315861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958169b6-0839-4e06-8ac8-b9718ab5d215 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.349512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.350348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.350628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.350903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.361186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:50.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:50.369701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:50.370511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 284/579] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:50.371232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.386829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ebc0-f893-47af-b184-20034050a8e4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.421676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.422348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.422632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.422909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.423667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:50.424009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.425402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.433123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 296/580] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:50.433995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.470430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0b718-4bda-4be8-a67a-3dfbc74dbd90 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.504677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.505343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.505625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.505897 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.506726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:50.507034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.508521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.526017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 285/581] 10.222.0.99 () {56 vars in 1137 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:50.526818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.541783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce65c5d-0159-4cc6-8fe3-637675cc924b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.580379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.581037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.581320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.581597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.582432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=6f71bb499b4e4f5cbb0caeee2d30387a) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:50.582745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.584227 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.589652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 297/582] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/role_assignments?user.id=6f71bb499b4e4f5cbb0caeee2d30387a&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:50.590460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.624855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3e88b-41b2-46fe-b5b4-04537e0ac254 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.660494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.661402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.661682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.661947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/38f74d30b6da44cb8f60e87f44da4ff5/roles/2a865ee865184972b66c89d62f6071fd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.679015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=38f74d30b6da44cb8f60e87f44da4ff5, role_id=2a865ee865184972b66c89d62f6071fd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.680929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.703901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 286/583] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:50 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/38f74d30b6da44cb8f60e87f44da4ff5/roles/2a865ee865184972b66c89d62f6071fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:50.703901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.716518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69971a-15fe-4222-87b2-afa5e9f29fda None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.758016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.759069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.759847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.760152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.761241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:50.761544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.764052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.777634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 298/584] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:50.779009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.814198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af1d60-b98d-4445-bc45-31fd4fa6bd99 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.860602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.861424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.861701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.861972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.872829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.874322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:50.893076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:50.894003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:50.894895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:50.894895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:50.894895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:50.894895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:50.899123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 287/585] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:50.900094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:50.917486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac34f1-b108-4cec-8ac3-d03d19b9e993 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:50.961951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:50.963107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:50.963591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:50.964116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:50.979118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:50.981899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:51.002035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:51.003008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:51.004523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:51.004523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:51.004523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:51.004523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:51.004523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 299/586] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:51.004523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.018784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f23618-472b-4bd6-840e-b27e21d484fb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.061807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.063378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.064147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.064601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.078106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.080358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.104092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d3e3-ca22-4479-8e2e-d7ac97060bdd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:51.104485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:51.105323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:51.106408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:51.106408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:51.106408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:51.106408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:51.109720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 288/587] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:51.110769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.149371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.151362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.151792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.152190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.153563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:51.154721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.158229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.176482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 300/588] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:51.177379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.235166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad51dd-f090-4f77-a619-a7070667a69a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.269589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.270617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.271063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.271496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.272492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:51.273023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.274841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.277673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9b789-26e6-4b44-b59e-ff87f47c5a61 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.287428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 289/589] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:51.288728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.317140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.317821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.318101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.318433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.319200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:51.319509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.320919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.333014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 301/590] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:51.334011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.394604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7fbf-af4a-41ea-8ea0-29d9fe043927 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.431161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.432387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.432864 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.433197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912359f-f916-40a7-8a7c-df84af6b5b8f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.433588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.441786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.443547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:51.458162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:51.459153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 14:40:51.460112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:51.462747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 290/591] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:51.463768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.472557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.473684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.476224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.476517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.483957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.485414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:51.500237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:51.501161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:51.502035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:51.506162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 302/592] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:51.506996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.569665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db856e8-21c7-4721-9946-2c52d0442deb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.602903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.604086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.604580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.605065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.607195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01702a7b-2f39-49f6-be9f-eb21ba6317fe None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.613468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.615154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:51.629103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:51.630028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:40:51.631057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:51.633631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 291/593] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:51.634647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.641020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.641745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.642029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.642304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.643192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:51.643505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.644971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.667169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 303/594] 10.222.0.99 () {56 vars in 1137 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:51.668112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.753892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0e0d0-df12-4a83-a018-2618fd6847f2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.772117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2b0f-8fed-493d-b38b-ecf46b984cb6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.796408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.797081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.797361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.797643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.799088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:51.799397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.801224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.811131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.812156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.812679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.813160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.814418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:51.815000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.815262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 292/595] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:51.817478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.820250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.839549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 304/596] 10.222.0.99 () {56 vars in 1139 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:51.841001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:51.922522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e085e03-051d-4ada-80b7-f39543dcad98 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.944806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688064d-ec54-4da1-8d67-f1037eb4fdf9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:51.956590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.957410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.957913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.957913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.968830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:51.970374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:51.982245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:51.983440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:51.983935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:51.984399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/e156813f50bf4f1193ecb279fad65b04/roles/2a865ee865184972b66c89d62f6071fd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:51.989469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:51.990393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:51.991296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:51.991296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:51.991296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:51.991296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:51.995318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 293/597] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:51.996813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.005990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=e156813f50bf4f1193ecb279fad65b04, role_id=2a865ee865184972b66c89d62f6071fd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.008256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.024885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 305/598] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:51 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/e156813f50bf4f1193ecb279fad65b04/roles/2a865ee865184972b66c89d62f6071fd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:52.026124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.146354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6a506-e6dd-4642-a188-efad3c582da0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:52.169522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1434605-bad3-41cd-b338-57c6fa9f3366 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:52.187037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:52.188173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:52.188715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:52.189186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:52.190124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:52.190624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.192218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.208197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 306/599] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:52.220660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.228640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:52.229449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:52.229728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:52.234710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:52.260769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.262221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:52.300268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:52.301306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:52.302283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:52.302283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:52.302283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:52.302283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:52.311828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 294/600] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:52.316603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.386283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51668-5515-4ffa-a961-22efd4e76a86 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:52.433154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:52.434970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:52.435452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:52.436026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:52.445066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.447658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:52.464686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:52.465818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:52.466695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:52.471514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 307/601] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:52.477748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.484201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f97b-ad81-4298-866d-487546a7095c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:52.524161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:52.525018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:52.525408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:52.525767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:52.526644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:52.527064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.528660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.548021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 295/602] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:52.554160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.600166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774ffd-c95f-41c2-911d-92cc0c41049c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:52.648997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:52.649772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:52.649995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:52.655908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:52.655908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:52.655908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.655908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.665314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 308/603] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:52.671330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.671900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c8c7-66f4-4524-a524-9c2526b6118d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:52.718318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:52.719129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:52.719405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:52.719662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:52.733614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.738907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:52.761942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:52.764286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:52.765410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 296/604] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:52.776976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:52.874626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92550700-24e2-4443-af80-1e6b9d3181e6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:52.926916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:52.927843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:52.928153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:52.928426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/1e1525affb11454d977ac931c4feb822/roles/2a865ee865184972b66c89d62f6071fd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:52.948376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=1e1525affb11454d977ac931c4feb822, role_id=2a865ee865184972b66c89d62f6071fd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:52.950847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:52.972646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 309/605] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:52 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/1e1525affb11454d977ac931c4feb822/roles/2a865ee865184972b66c89d62f6071fd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:40:53.004797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2b990-c0e7-456c-a521-90a3a3692244 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:53.048938 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287177-927c-4226-bc8a-649cbf0075d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:53.049637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287177-927c-4226-bc8a-649cbf0075d2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.049993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287177-927c-4226-bc8a-649cbf0075d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.050336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287177-927c-4226-bc8a-649cbf0075d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.051250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287177-927c-4226-bc8a-649cbf0075d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:53.051638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287177-927c-4226-bc8a-649cbf0075d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:53.053288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287177-927c-4226-bc8a-649cbf0075d2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:53.067645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 297/606] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:53.075811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:53.166349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94822b25-d8a9-4353-9772-fd064e71e6f5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.166736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94822b25-d8a9-4353-9772-fd064e71e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.167316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94822b25-d8a9-4353-9772-fd064e71e6f5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.169977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 298/607] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:40:53.185823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2cd24-2514-47eb-a9da-03a1ffdea28c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.186664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2cd24-2514-47eb-a9da-03a1ffdea28c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.187053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2cd24-2514-47eb-a9da-03a1ffdea28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.206452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79da6b-674a-42dc-a0f8-ecaee86fc095 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:53.216360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3af2cd24-2514-47eb-a9da-03a1ffdea28c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:53.217622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3af2cd24-2514-47eb-a9da-03a1ffdea28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:53.252145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee514-03d8-4b06-902c-4c1097d22108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:53.253447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee514-03d8-4b06-902c-4c1097d22108 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.253953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee514-03d8-4b06-902c-4c1097d22108 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.254434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee514-03d8-4b06-902c-4c1097d22108 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/81e8247739e24fcd9b067f1aa1cb9b79/roles/2a865ee865184972b66c89d62f6071fd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.271026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee514-03d8-4b06-902c-4c1097d22108 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=81e8247739e24fcd9b067f1aa1cb9b79, role_id=2a865ee865184972b66c89d62f6071fd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:53.272568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee514-03d8-4b06-902c-4c1097d22108 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:53.287355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 310/608] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:53 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/81e8247739e24fcd9b067f1aa1cb9b79/roles/2a865ee865184972b66c89d62f6071fd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:53.287809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5268-25f9-4b94-9fa3-e2abd44776f0 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.288449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5268-25f9-4b94-9fa3-e2abd44776f0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.288449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5268-25f9-4b94-9fa3-e2abd44776f0 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.289918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 311/609] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:53.296801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2979d-9fdc-4878-967f-5bba9fbfff52 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.297137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2979d-9fdc-4878-967f-5bba9fbfff52 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.297394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2979d-9fdc-4878-967f-5bba9fbfff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.303488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 299/610] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:40:53.316289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6ec2979d-9fdc-4878-967f-5bba9fbfff52 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:53.317409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6ec2979d-9fdc-4878-967f-5bba9fbfff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:53.329179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2cd24-2514-47eb-a9da-03a1ffdea28c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:53.396034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 312/611] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:53.419654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2979d-9fdc-4878-967f-5bba9fbfff52 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:53.489929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2cd24-2514-47eb-a9da-03a1ffdea28c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:53.574675 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2979d-9fdc-4878-967f-5bba9fbfff52 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:53.589447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:53.590930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.591936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.592551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.608214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:53.613951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:53.614840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.615238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.615583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:53.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:53.619489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:53.620371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:53.623350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 300/612] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:53.628799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:53.630774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:53.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:53.640707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:53.641540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 313/613] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:53.647175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:53.768125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e0f6-9ed7-42ea-9681-40b14a41be8a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:53.791596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd258f2-8eb1-4893-b06e-e86268903084 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:53.828825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:53.829424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.829703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.829974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.830727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:53.831029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:53.832428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:53.846709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 314/614] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:53.852414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:53.854243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:53.854923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:53.855203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:53.855473 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:53.856572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:53.856882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:53.858493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:53.868409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 301/615] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:53.874576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:53.988654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981e10-4570-4297-b4e4-f1894428fd30 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.025449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93b85-dd2b-42d0-9895-dd7b80152fe8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.035890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.035890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.035890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.035890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:54.051113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:54.052606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:54.078110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:54.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:54.080020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:54.080020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:54.080020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:54.080020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:54.080685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 315/616] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:40:54.091392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:54.097036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.097845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.098434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.098706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:54.116562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:54.118044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:54.136922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:54.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:54.140083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:54.140083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:54.140083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:54.140083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:54.140083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 302/617] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:54.143857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:54.235391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dfad9-2ceb-4b8a-a4d5-6fabbc73be61 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.271541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.272705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.273165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.273730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:54.274908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:54.275415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:54.277016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:54.297407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 316/618] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:54.303945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:54.374436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b779dd3-4711-4d8b-aafc-481d2e6f77b2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.419067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.419688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.420148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.420428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:54.422088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:54.422402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:54.423790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:54.437791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 303/619] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:54.446369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:54.472220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01fe14-ad5f-4a4e-9ae0-ac1fd3b8078e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.537062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.537954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.538357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.538637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:54.557076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:54.558541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:54.583997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:54.585048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:40:54.585995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:54.596138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 317/620] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:40:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:54.602095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:54.630248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98a99-f5a5-4eb6-a859-531c28dff530 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.710198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.711046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.711596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.711596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:54.728976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:54.729905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744036ea-0fef-4d6b-a0e5-f6a1b3f890d6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.730432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:54.763898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:54.764147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:54.765232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:54.766378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 304/621] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:54.767842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.768330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.769194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:54.770478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:54.770935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:54.771153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:54.772846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:54.792507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 318/622] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:40:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:54.798620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:54.904723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb434e-c847-4972-a96d-8f8ee044a198 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:54.939566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa06cb-9cf4-4019-8231-119fa4e89f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:54.940539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa06cb-9cf4-4019-8231-119fa4e89f92 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:54.940995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa06cb-9cf4-4019-8231-119fa4e89f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:54.941410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa06cb-9cf4-4019-8231-119fa4e89f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.009332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa06cb-9cf4-4019-8231-119fa4e89f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.011062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa06cb-9cf4-4019-8231-119fa4e89f92 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.026722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719126a8-7ffd-439d-91ca-dc113fcabdcf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.092547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.093509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.093793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.094071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.095072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:55.095389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.097185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.113327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 319/623] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:40:55.119149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535792da-e3e5-486a-8c92-3bfacd9b2053 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.119290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 305/624] 10.222.0.99 () {56 vars in 1135 bytes} [Fri May 13 14:40:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:40:55.119883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535792da-e3e5-486a-8c92-3bfacd9b2053 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.120204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.120485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535792da-e3e5-486a-8c92-3bfacd9b2053 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.122437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 320/625] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:55.128814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd645da-b6aa-4a56-ba2c-6ea6d35c8b4d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.129298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd645da-b6aa-4a56-ba2c-6ea6d35c8b4d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.129740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd645da-b6aa-4a56-ba2c-6ea6d35c8b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.150408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3dd645da-b6aa-4a56-ba2c-6ea6d35c8b4d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:55.152302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3dd645da-b6aa-4a56-ba2c-6ea6d35c8b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:55.231281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 321/626] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:55.233084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd645da-b6aa-4a56-ba2c-6ea6d35c8b4d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.238410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb60c-46dc-41be-b068-182c42c3018b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.281421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.282467 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.282908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.283368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.294304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.296249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:55.314400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:55.315497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:55.316619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:55.316619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:55.316619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:55.316619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:55.318446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 306/627] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:55.323610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.341251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd645da-b6aa-4a56-ba2c-6ea6d35c8b4d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.375180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.376012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.376291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.376883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.387194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.388689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:55.407918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:55.409051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:55.410111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:55.410111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:55.410111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:55.410111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:55.410111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 322/628] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:55.410388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.426613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3ba8-7edf-46b1-9662-3e23f04bf1b1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.461433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.462534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.463002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.463435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.474869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:55.483278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:55.484414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:55.485262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:55.488074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 307/629] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:55.489167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.515704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daaca-d0ff-4a64-b21f-0e13cac717f4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.550788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.551582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.551964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.552338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.553091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:55.553568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.554884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.571032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 323/630] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:55.571032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.600269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfbdf2-ab5c-4690-b5c0-73df83887d38 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.634840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.636720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.637267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.637751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.638661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:55.639154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.640779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.657005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 308/631] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:55.658690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.671998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034418-dae3-4f49-ba58-1676fd4b2a2b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.705619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.706306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.706584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.706852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.707596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:55.707919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.709286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.722662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 324/632] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:55.722662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.770258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ad9d4-241a-4d8b-8b27-b978d11f66f3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.805666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7bd2e-7b27-4b91-a1f0-9c4eeb74d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.806499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7bd2e-7b27-4b91-a1f0-9c4eeb74d1ff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.806775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7bd2e-7b27-4b91-a1f0-9c4eeb74d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.807048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7bd2e-7b27-4b91-a1f0-9c4eeb74d1ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.813928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7bd2e-7b27-4b91-a1f0-9c4eeb74d1ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.815395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7bd2e-7b27-4b91-a1f0-9c4eeb74d1ff None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.816557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09003016-1ab5-4be9-a2f6-1b6b75d8c070 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c5b7bd2e-7b27-4b91-a1f0-9c4eeb74d1ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:55.829420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:55.830373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:55.831357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 309/633] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:55.831853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394889-19e7-489c-a81e-d78edf81ad4f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.832433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394889-19e7-489c-a81e-d78edf81ad4f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.832433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394889-19e7-489c-a81e-d78edf81ad4f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.833706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 310/634] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:55.834270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1394889-19e7-489c-a81e-d78edf81ad4f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.860283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.861084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.861366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.861635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.868557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.869992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:55.883992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:55.884980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:55.885856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 325/635] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:55.886333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:55.941021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1394889-19e7-489c-a81e-d78edf81ad4f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.977435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ab71-3874-4b13-8e69-862d6af67a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:55.978230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ab71-3874-4b13-8e69-862d6af67a35 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:55.978511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ab71-3874-4b13-8e69-862d6af67a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:55.978785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ab71-3874-4b13-8e69-862d6af67a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:55.987372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379763c-6d77-47c6-91df-b6f57ca4cd10 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:55.990490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ab71-3874-4b13-8e69-862d6af67a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:55.992002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ab71-3874-4b13-8e69-862d6af67a35 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5123ab71-3874-4b13-8e69-862d6af67a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:56.008951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:56.009990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:56.011031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:56.011031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:56.011031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:56.011031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:56.014694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 311/636] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:56.015944 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063038-c1d6-4dff-84d7-7548576730a2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.016235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063038-c1d6-4dff-84d7-7548576730a2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.016511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063038-c1d6-4dff-84d7-7548576730a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.024441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.025275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.025694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.026104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.027018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:56.027486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.029128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.033281 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b0063038-c1d6-4dff-84d7-7548576730a2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:56.034462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b0063038-c1d6-4dff-84d7-7548576730a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:56.045987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 326/637] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:56.045987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.104800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 312/638] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:56.105658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063038-c1d6-4dff-84d7-7548576730a2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.139938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25d324-8f08-4690-9a73-e19fc84b62af None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.171847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.172533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.172813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.173088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.173876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:56.174183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.175605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.186987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 327/639] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:56.187775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.200587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063038-c1d6-4dff-84d7-7548576730a2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.234094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0582c9-e0a9-4313-a1d6-811cbe95f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.234924 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0582c9-e0a9-4313-a1d6-811cbe95f176 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.235203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0582c9-e0a9-4313-a1d6-811cbe95f176 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.235472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0582c9-e0a9-4313-a1d6-811cbe95f176 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.236301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0582c9-e0a9-4313-a1d6-811cbe95f176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:56.236601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0582c9-e0a9-4313-a1d6-811cbe95f176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.237993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0582c9-e0a9-4313-a1d6-811cbe95f176 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.249310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 313/640] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:56.250334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8695-404e-434e-bbfa-e249cf97cf60 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.250594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8695-404e-434e-bbfa-e249cf97cf60 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.250866 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8695-404e-434e-bbfa-e249cf97cf60 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.252325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 314/641] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:56.252930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a8695-404e-434e-bbfa-e249cf97cf60 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.284768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4d082-99f9-4781-8def-e097594e5a6c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.316937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.317612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.317878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.318152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.319002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=38f74d30b6da44cb8f60e87f44da4ff5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:56.319310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.320780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.326515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 328/642] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/role_assignments?user.id=38f74d30b6da44cb8f60e87f44da4ff5&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:56.327290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.355068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a8695-404e-434e-bbfa-e249cf97cf60 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.393406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.394424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.394569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.394752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.406892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:56.414440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:56.415653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 315/643] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:56.421908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.442545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2405-4e8e-4c25-9593-1ae8213941d4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.480915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317310-f032-4f0d-9836-1f27c20ef800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.481921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317310-f032-4f0d-9836-1f27c20ef800 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.482201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317310-f032-4f0d-9836-1f27c20ef800 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.482748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317310-f032-4f0d-9836-1f27c20ef800 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/6f71bb499b4e4f5cbb0caeee2d30387a/roles/2a865ee865184972b66c89d62f6071fd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.498170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f317310-f032-4f0d-9836-1f27c20ef800 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=6f71bb499b4e4f5cbb0caeee2d30387a, role_id=2a865ee865184972b66c89d62f6071fd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.499635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f317310-f032-4f0d-9836-1f27c20ef800 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.514580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 329/644] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:40:56 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/6f71bb499b4e4f5cbb0caeee2d30387a/roles/2a865ee865184972b66c89d62f6071fd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:40:56.515949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934f6d-3e96-4a87-a1c9-a14c8789dc8a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.516239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934f6d-3e96-4a87-a1c9-a14c8789dc8a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.516516 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934f6d-3e96-4a87-a1c9-a14c8789dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.541430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb5246-f274-40f2-bfb1-6f4fd4cd65d6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.549275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-71934f6d-3e96-4a87-a1c9-a14c8789dc8a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:56.550874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-71934f6d-3e96-4a87-a1c9-a14c8789dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:56.578508 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.579254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.579534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.579805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.589217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.590770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:56.609706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:56.610758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:56.612070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 316/645] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:56.616980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.641233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 330/646] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:56.642197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71934f6d-3e96-4a87-a1c9-a14c8789dc8a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.734107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d89e-069d-46c2-a041-ef55cad96148 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.757019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71934f6d-3e96-4a87-a1c9-a14c8789dc8a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.776122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.777162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.777805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.778374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.779310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:56.779804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.781415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.790866 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 317/647] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:56.791371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.795951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.795951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.795951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.795951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:56.795951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.795951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.796974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.813626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 331/648] 10.222.0.99 () {56 vars in 1137 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:56.814995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.898511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589a87-4468-4f06-a506-343194f2da1b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.914511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3356df-4bc2-48e1-8079-a99f7d0cc1d8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:56.932871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.934147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.934619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.935079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.945911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:56.948254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:56.949054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:56.949367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:56.949647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:56.955461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:56.956414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:56.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:56.959925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 318/649] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:56.960284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:56.961121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:56.961784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:56.984662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:56.985679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:56.986567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:56.986567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:56.986567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:56.986567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:56.986567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 332/650] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:56.987835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.083748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5cb79-b208-46b2-91eb-6c20d5b209ed None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.091349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f5a8f-361a-4339-a2a5-a256755dc7c8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.124347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.124557 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.125178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.125312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.125588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.125698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.125989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.126092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.126909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:57.127302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.128811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.142715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 333/651] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:57.143754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.214630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.216666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.246901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a2ae-818c-4da9-857b-e21b6a1806fc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.281477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.282300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.282688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.283060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.283897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:57.284330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.285799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.298536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 334/652] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:57.299577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.337898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 319/653] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:57.338842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.410735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e89d2-c061-4153-a43d-19b39f2b969d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.441071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f7fc1-509d-414f-91e9-ed589e1f850f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.445794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.446725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.447103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.447473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.458771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.460441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.475860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.476873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.477153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.477423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:57.479637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:57.481373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:57.483407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:57.483407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:57.483407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:57.483407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:57.486630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.491889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 335/654] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:57.492090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.492264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:57.502001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:57.504110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 320/655] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:57.506376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.590253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b31b92-f652-4fd8-a95b-79820c4ab277 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.600050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98f77a-95d9-4e13-8566-c286bed47e21 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.625064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.625882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.626164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.626435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.635679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.636403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.636684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.637006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.637468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.637822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:57.638130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.638939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.639640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.655462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 321/656] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:57.655462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:57.661892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:57.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:57.664005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:57.664005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:57.664005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:57.664005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:57.665572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 336/657] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:57.666473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.754828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bae3ab-b512-49a1-8d35-653b37e07f66 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.768787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d891894-a7c0-49a8-b7e5-33137cac4e7d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.794430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.795443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.795920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.796386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.797392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:57.797875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.799520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.808015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.809474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.809846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.810188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.819397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 322/658] 10.222.0.99 () {56 vars in 1137 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:57.823854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.823854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.825149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:40:57.839590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:57.840874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:40:57.841818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:57.843952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 337/659] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:57.845009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:57.939058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217343-2f5a-4d80-a3cf-fcba2f63f5a4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.960327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6015c-154a-4a37-bc6c-7bf4dafdacb9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:57.974052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.975014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.975493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.976029 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.976964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:57.977462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:57.979015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:57.995329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:57.995329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:57.995329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:57.995669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:57.995964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 323/660] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:57.997237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.062821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.064327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.098323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcd8e-29c3-42ea-8773-b6a8a621bf7c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.131984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.133012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.133515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.133983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.135699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:58.136299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.138113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.160661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 324/661] 10.222.0.99 () {56 vars in 1139 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:58.161929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.162972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 338/662] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:58.163826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.259893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318411c4-7d12-42f7-ace8-b4d3599045af None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.266251 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90268af-26cd-4317-9f33-9f74b0147c08 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.293709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.294343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.294646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.294945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.302316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.303471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.303990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.304463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.312275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.314025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:58.329168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:58.330147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:58.331064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:58.337993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 325/663] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:58.339138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.365006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.366477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.474167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c30e1-1507-4695-aa62-b1d45206dafa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.487514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 339/664] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:40:58.487514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.525002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.526198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.526620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.527906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.541701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.544167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:58.566391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:58.567540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:58.568662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:58.568662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:58.568662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:58.568662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:58.576902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 326/665] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:58.578149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.608458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34465-e094-4544-8883-6a25c2dcfc2e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.645702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.646503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.646954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.647246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.648259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:58.648657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.650308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.669572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 340/666] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:58.669572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.696554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abecb7-276d-43fe-9adf-1f676f3088b0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.729960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.731004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.731383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.731785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.742909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.744513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:40:58.762183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:58.763123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:58.764056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:40:58.764056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:40:58.764056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:40:58.764056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:58.764056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 327/667] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:58.764347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.786796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c545c-10e3-4f09-be9e-c961ed77b963 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.819940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149dc84-9913-45d4-ab90-4484e1a4b346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.820618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149dc84-9913-45d4-ab90-4484e1a4b346 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.820902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149dc84-9913-45d4-ab90-4484e1a4b346 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.821172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149dc84-9913-45d4-ab90-4484e1a4b346 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.821900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149dc84-9913-45d4-ab90-4484e1a4b346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:58.822205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149dc84-9913-45d4-ab90-4484e1a4b346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.823567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149dc84-9913-45d4-ab90-4484e1a4b346 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.839964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 341/668] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:58.839964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f4d7-4934-4b37-998f-7e268ec4de04 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.839964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f4d7-4934-4b37-998f-7e268ec4de04 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.839964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f4d7-4934-4b37-998f-7e268ec4de04 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.839964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 342/669] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:58.839964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f4d7-4934-4b37-998f-7e268ec4de04 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.865664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef2be4-d0a9-422d-acfe-37b297b8388f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.898230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.898848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.899098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.899376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.900240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=e156813f50bf4f1193ecb279fad65b04) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:58.900553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.901996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.907666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 328/670] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/role_assignments?user.id=e156813f50bf4f1193ecb279fad65b04&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:58.908478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:58.944167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f4d7-4934-4b37-998f-7e268ec4de04 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:58.981510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f96a32-c83b-4749-aad2-3c3b254b8f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:58.982173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f96a32-c83b-4749-aad2-3c3b254b8f69 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.982460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f96a32-c83b-4749-aad2-3c3b254b8f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.982736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f96a32-c83b-4749-aad2-3c3b254b8f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:58.983469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f96a32-c83b-4749-aad2-3c3b254b8f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:58.983774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f96a32-c83b-4749-aad2-3c3b254b8f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:58.985208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f96a32-c83b-4749-aad2-3c3b254b8f69 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:58.997328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 343/671] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:58.998764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb382d8-b3a6-481d-876b-ebdb19c35b00 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:58.999056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb382d8-b3a6-481d-876b-ebdb19c35b00 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:58.999335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb382d8-b3a6-481d-876b-ebdb19c35b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.017480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-deb382d8-b3a6-481d-876b-ebdb19c35b00 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:59.018703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-deb382d8-b3a6-481d-876b-ebdb19c35b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:59.025804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a486b-074a-4de6-8e4f-28ffc6137395 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.063326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366766d-9ba3-4fb0-a4d7-289fd4e34a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.064491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366766d-9ba3-4fb0-a4d7-289fd4e34a03 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.064978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366766d-9ba3-4fb0-a4d7-289fd4e34a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.065405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366766d-9ba3-4fb0-a4d7-289fd4e34a03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.073194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366766d-9ba3-4fb0-a4d7-289fd4e34a03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.075008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366766d-9ba3-4fb0-a4d7-289fd4e34a03 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.086924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 344/672] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:59.088401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce5da-5fe0-4c75-a91e-0f4bfa037d53 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.088693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce5da-5fe0-4c75-a91e-0f4bfa037d53 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.088969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce5da-5fe0-4c75-a91e-0f4bfa037d53 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.090603 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 345/673] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:40:59.091308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce5da-5fe0-4c75-a91e-0f4bfa037d53 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9366766d-9ba3-4fb0-a4d7-289fd4e34a03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:59.091629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:59.092637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:59.093518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:59.097477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 329/674] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:59.099136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4987-9d63-4e63-96b5-7d2fd2543bd5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.099653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4987-9d63-4e63-96b5-7d2fd2543bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.099736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4987-9d63-4e63-96b5-7d2fd2543bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.118130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-35de4987-9d63-4e63-96b5-7d2fd2543bd5 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:40:59.119720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-35de4987-9d63-4e63-96b5-7d2fd2543bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:40:59.204483 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 330/675] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:40:59.206077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de4987-9d63-4e63-96b5-7d2fd2543bd5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.220951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce5da-5fe0-4c75-a91e-0f4bfa037d53 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.255946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.256757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.257051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.257402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.265048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.266504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:40:59.280866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:59.281770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:59.282657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 346/676] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:59.283742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.318015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de4987-9d63-4e63-96b5-7d2fd2543bd5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.353785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.354737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.355327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.355838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.356849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:59.357301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.358979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.371432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 331/677] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:59.372570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.391477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ce342-bc1b-41cb-9cca-e12ee6b022c3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.425431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.426256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.426532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.426804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.438082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:59.445633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:59.446590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:40:59.447428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 347/678] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:59.448334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.476354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e644d9-b08c-49b7-8613-56a3d9ce23fd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.511116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.512373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.512805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.513225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.526824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:40:59.534764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:40:59.536003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:40:59.537038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:40:59.538838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 332/679] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:40:59.539670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.551672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232c2b-e3d9-4b1a-b705-9c7571e99343 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.584395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.585198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.585573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.585964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.586813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:59.587181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.588726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.605854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 348/680] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:59.605854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.640146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7b97-7ed8-44b0-9cd1-da8204493638 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.673198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.673861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.674139 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.674413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.675250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=1e1525affb11454d977ac931c4feb822) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:59.675539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.677021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.687905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 333/681] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/role_assignments?user.id=1e1525affb11454d977ac931c4feb822&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:59.687905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.697590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86074f9d-a7cd-407f-8860-c86254b9defb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.734173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.734995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.735339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.735674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.736541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:59.736912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.738392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.747496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 349/682] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:59.748487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.813687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae18f2-4055-4971-a35c-7ad65a5c1c7b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.856934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.857786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.858186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.858532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.859368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:59.859744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.861272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.870475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 334/683] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:59.871787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.874489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bef54-5388-4917-9b21-6c42c24a9512 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:40:59.910759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:40:59.911534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:40:59.911818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:40:59.912127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:40:59.912970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=81e8247739e24fcd9b067f1aa1cb9b79) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:40:59.913287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:40:59.914734 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:40:59.920987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 350/684] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/role_assignments?user.id=81e8247739e24fcd9b067f1aa1cb9b79&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:40:59.927904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:40:59.998861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5adde6-e3ff-4bda-9eeb-91afef8d3434 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.038260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.039126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.039413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.039689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.052737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.052955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8809aa-63c3-4eeb-82d8-56871128ef57 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.054346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:00.077031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:00.078014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:00.078922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:00.078922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:00.078922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:00.078922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:00.079165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 335/685] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:00.088943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.098609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.099426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.099706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.100112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.115511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.116426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:00.144841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:00.145825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:00.146763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:00.146763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:00.146763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:00.146763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:00.146763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 351/686] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:00.152501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.225078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d328471-6a58-41d2-9885-dad751cd513a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.269658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32548a0-742b-496c-9d74-d346ae752f70 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.271708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.273343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.273730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.274101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.274921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:00.275322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.276831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.293199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 336/687] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:00.299605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.318749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.320849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.321510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.323470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.325995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:00.327747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.329726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.354679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 352/688] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:00.360132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.492687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17023-0452-4d27-b6c6-083e22a6e57d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.540032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156d17-c372-4866-b1c3-99dd92269df2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.560340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.561148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.561430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.561705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.570267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.571727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:00.588417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:00.589487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:00.590517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 337/689] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:00.598122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.601476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.602448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.602876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.603508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.620485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.622294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:00.648470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:00.649674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:00.650813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:00.665468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 353/690] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:00.673525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.785388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cda272-3d55-4c99-bde6-85b7c9bedc5e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.822778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d2e62-aa7e-4d05-86bf-e3f836a603a3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:00.829459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.830411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.830841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.836416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.837446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:00.837906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.839546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.860225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 354/691] 10.222.0.99 () {56 vars in 1135 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:00.868944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.887948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:00.888544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:00.888884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:00.889161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:00.890079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:00.890388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:00.891918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:00.925720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 338/692] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:00.932793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:00.975366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191f35-992c-43d0-a659-ec90d18f680d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.017465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.018495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.019001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.019467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.063922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c759fb7-165f-41c5-bec2-1cc831b88bb2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.101347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f147815-e403-408a-b207-050114836221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.102040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f147815-e403-408a-b207-050114836221 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.102388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f147815-e403-408a-b207-050114836221 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.102654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f147815-e403-408a-b207-050114836221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.114146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.116229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.217200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f147815-e403-408a-b207-050114836221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.218248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 355/693] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:41:01.223319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f147815-e403-408a-b207-050114836221 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.224680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.321557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ed35b-4795-42d9-927a-f73a798c3e4f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.323652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 339/694] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:41:01.329420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f147815-e403-408a-b207-050114836221 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.369225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.370376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.370880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.371393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.382171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.383930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:01.416622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:01.417590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:01.418771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:01.418771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:01.418771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:01.418771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:01.421191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 356/695] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:01.427308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.437258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f147815-e403-408a-b207-050114836221 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.515470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.516158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.516435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.516705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.535806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.537307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.541699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9c28-29a7-41a2-a96a-0ecb9d5873a1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:01.571663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:01.572637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:01.573523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:01.573523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:01.573523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:01.573523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:01.573523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 340/696] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:01.577948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.578444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.579185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.579662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.580153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.581095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:01.581616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.583183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.595296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 357/697] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:01.601269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.710158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d06ab5-83b8-4f1f-bba7-a1ea337b4409 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.731205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66494c1-aa64-4a1d-b650-d0564b11f337 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.751601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.752759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.753256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.753725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.763288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.765794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.769813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca57c6-8d82-4eb4-9308-565fe739a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.770564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca57c6-8d82-4eb4-9308-565fe739a7dc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.770909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca57c6-8d82-4eb4-9308-565fe739a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.771247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca57c6-8d82-4eb4-9308-565fe739a7dc None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.772067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca57c6-8d82-4eb4-9308-565fe739a7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:01.772444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca57c6-8d82-4eb4-9308-565fe739a7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.773899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca57c6-8d82-4eb4-9308-565fe739a7dc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:01.784286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:01.785202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:01.786094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:01.786524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 341/698] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:01.788003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26b8e-e9f3-46e4-bea3-40d6a2197e4a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.788358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26b8e-e9f3-46e4-bea3-40d6a2197e4a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.788704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26b8e-e9f3-46e4-bea3-40d6a2197e4a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.789522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 358/699] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:01.794480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 342/700] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:01.795363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26b8e-e9f3-46e4-bea3-40d6a2197e4a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.795720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.916848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d81e7-8a10-47c8-99f5-ec8c3bd1c5c4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.918775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26b8e-e9f3-46e4-bea3-40d6a2197e4a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:01.955551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.956697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.956806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d110-a733-407a-96d7-3d81db0cf30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:01.957279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.957648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d110-a733-407a-96d7-3d81db0cf30a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.957939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.958051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d110-a733-407a-96d7-3d81db0cf30a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.958309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d110-a733-407a-96d7-3d81db0cf30a None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.959242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847d110-a733-407a-96d7-3d81db0cf30a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:01.959612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847d110-a733-407a-96d7-3d81db0cf30a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.961834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847d110-a733-407a-96d7-3d81db0cf30a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.966234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:01.967927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:01.975545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 359/701] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:01.976940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353185fe-72a9-4968-8edd-dfab912d9a8e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:01.977335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353185fe-72a9-4968-8edd-dfab912d9a8e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:01.977715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353185fe-72a9-4968-8edd-dfab912d9a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:01.984123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:01.985017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:01.985899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:01.988487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 343/702] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:01.989523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:01.996821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-353185fe-72a9-4968-8edd-dfab912d9a8e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:01.998098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-353185fe-72a9-4968-8edd-dfab912d9a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:02.083944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 360/703] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:41:02.085135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353185fe-72a9-4968-8edd-dfab912d9a8e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:02.103014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfbf4-b58a-481b-84c6-1b8997342e94 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:02.138164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:02.139162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.139616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.140090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.141094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=6f71bb499b4e4f5cbb0caeee2d30387a) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:02.141594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:02.143224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:02.149700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 344/704] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:01 2022] GET /identity/v3/role_assignments?user.id=6f71bb499b4e4f5cbb0caeee2d30387a&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:02.150842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:02.221334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353185fe-72a9-4968-8edd-dfab912d9a8e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:02.271485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641291b-3262-42c0-9e56-4b83dcde3407 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:02.291602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:02.292804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.293579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.294890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.296031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:02.296821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:02.300402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:02.322671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 361/705] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:02.329673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:02.342138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:02.343800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.346958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.347967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.349087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:02.351039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:02.381584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:02.382670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:02.383610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:02.387180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 345/706] 10.222.0.99 () {56 vars in 1129 bytes} [Fri May 13 14:41:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:02.397818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:02.494401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198c724-b371-40b6-87af-9267b6e2b157 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:02.542597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228b78-4a26-4b61-8554-35b73ed30793 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:02.544409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb2efd-cba4-4def-b2da-b344ae9bab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:02.545084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb2efd-cba4-4def-b2da-b344ae9bab1f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.545368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb2efd-cba4-4def-b2da-b344ae9bab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.545644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb2efd-cba4-4def-b2da-b344ae9bab1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.546878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb2efd-cba4-4def-b2da-b344ae9bab1f None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=38f74d30b6da44cb8f60e87f44da4ff5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:02.546878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb2efd-cba4-4def-b2da-b344ae9bab1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:02.548244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb2efd-cba4-4def-b2da-b344ae9bab1f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:02.556190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 362/707] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:02 2022] GET /identity/v3/role_assignments?user.id=38f74d30b6da44cb8f60e87f44da4ff5&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:02.557917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827174-f7f5-49e6-a1e3-9fe3b5595e02 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.558309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827174-f7f5-49e6-a1e3-9fe3b5595e02 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.558762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827174-f7f5-49e6-a1e3-9fe3b5595e02 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.561220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 363/708] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:02.563922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef2e4-faf2-4f04-915f-192466119c78 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.563922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef2e4-faf2-4f04-915f-192466119c78 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.563922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef2e4-faf2-4f04-915f-192466119c78 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.565975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 364/709] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:02.568801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76ee5d-f681-41bb-8804-2b591058df1d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.569531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76ee5d-f681-41bb-8804-2b591058df1d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.570113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76ee5d-f681-41bb-8804-2b591058df1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.591405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9369c-bbe3-43f8-ab8a-2dbb5f250d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:02.592239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6c76ee5d-f681-41bb-8804-2b591058df1d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:02.592737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9369c-bbe3-43f8-ab8a-2dbb5f250d89 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.593209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9369c-bbe3-43f8-ab8a-2dbb5f250d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.593468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6c76ee5d-f681-41bb-8804-2b591058df1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:02.593934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9369c-bbe3-43f8-ab8a-2dbb5f250d89 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.594883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9369c-bbe3-43f8-ab8a-2dbb5f250d89 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:02.595382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9369c-bbe3-43f8-ab8a-2dbb5f250d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:02.597113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9369c-bbe3-43f8-ab8a-2dbb5f250d89 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:02.602888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 346/710] 10.222.0.99 () {56 vars in 1124 bytes} [Fri May 13 14:41:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:02.607632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6731a4-0d86-41cd-ab81-6e751082c461 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.607632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6731a4-0d86-41cd-ab81-6e751082c461 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.607632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6731a4-0d86-41cd-ab81-6e751082c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.627049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-df6731a4-0d86-41cd-ab81-6e751082c461 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:02.629167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df6731a4-0d86-41cd-ab81-6e751082c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:02.675971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 365/711] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:41:02.676977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76ee5d-f681-41bb-8804-2b591058df1d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:02.736065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 347/712] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:41:02.737126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6731a4-0d86-41cd-ab81-6e751082c461 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:02.814847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76ee5d-f681-41bb-8804-2b591058df1d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:02.852773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:02.853456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.853741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.854023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.854741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:02.855156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:02.856656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:02.863073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 366/713] 10.222.0.99 () {56 vars in 1124 bytes} [Fri May 13 14:41:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:02.864001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:02.899045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6731a4-0d86-41cd-ab81-6e751082c461 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:02.960528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:02.961764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:02.962235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:02.962682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] PATH_INFO: `/v3/services/network` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:02.963601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:02.965628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:02.984014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:02.985102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:02.985948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:02.994616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 348/714] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:02 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:03.002046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:03.050688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d278e77-d6c0-4153-bbe8-bc1193930f0c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:03.113752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:03.115003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:03.115423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:03.115970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:03.128931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:03.130868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:03.152247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:03.153201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:03.154083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:03.154083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:03.154083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:03.154083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:03.156337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 367/715] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:03.163904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:03.177941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3340c-cd39-460b-8b55-19f8149b2d2f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:03.211618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:03.212321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:03.212669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:03.212949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:03.213658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:03.213962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:03.215572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:03.220641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 349/716] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:03.227712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:03.337957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109715-6eb9-4902-95b5-49879e39b659 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:03.402831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1052f4-c7b8-4652-ad2c-63203558bbc4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:03.407299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:03.408010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:03.408298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:03.408578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:03.409314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:03.409622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:03.411012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:03.437489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 368/717] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:03.441159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:03.474818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106388d-1734-40cd-b731-4af0ec847e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:03.475496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106388d-1734-40cd-b731-4af0ec847e66 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:03.475777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106388d-1734-40cd-b731-4af0ec847e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:03.476077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106388d-1734-40cd-b731-4af0ec847e66 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:03.476793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106388d-1734-40cd-b731-4af0ec847e66 None admin] RBAC: Adding query filter params (type=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:03.477102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106388d-1734-40cd-b731-4af0ec847e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:03.478631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106388d-1734-40cd-b731-4af0ec847e66 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:03.490521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 350/718] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:03.569948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a9372-1d27-4ef0-be4f-7e82bb773c2a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:03.606874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa44f39-46f3-47ce-ac5d-75282645e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:03.607574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44f39-46f3-47ce-ac5d-75282645e6e3 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:03.607861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44f39-46f3-47ce-ac5d-75282645e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:03.608170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44f39-46f3-47ce-ac5d-75282645e6e3 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:03.608900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa44f39-46f3-47ce-ac5d-75282645e6e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:03.610412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa44f39-46f3-47ce-ac5d-75282645e6e3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:03.637486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 369/719] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:41:03 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:04.782550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b24a9-7903-427a-af73-098d5ff1ba85 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:04.783052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b24a9-7903-427a-af73-098d5ff1ba85 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:04.783052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b24a9-7903-427a-af73-098d5ff1ba85 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:04.784642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 351/720] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:04.808803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7209c8-d55b-4992-80e2-73d70a23e48c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:04.809327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7209c8-d55b-4992-80e2-73d70a23e48c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:04.809327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7209c8-d55b-4992-80e2-73d70a23e48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:04.835952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3c7209c8-d55b-4992-80e2-73d70a23e48c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:04.837248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3c7209c8-d55b-4992-80e2-73d70a23e48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:04.926245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 370/721] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:41:04.961275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b24a9-7903-427a-af73-098d5ff1ba85 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.027704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203cd87-3203-497d-b491-7c90dcea51ba None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.028078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203cd87-3203-497d-b491-7c90dcea51ba None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.028298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203cd87-3203-497d-b491-7c90dcea51ba None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.029973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 371/722] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:05.036051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be27e-036a-498a-a189-5a9a4b49eb9e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.036235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be27e-036a-498a-a189-5a9a4b49eb9e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.036505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be27e-036a-498a-a189-5a9a4b49eb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.080362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-be9be27e-036a-498a-a189-5a9a4b49eb9e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:05.081567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-be9be27e-036a-498a-a189-5a9a4b49eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:05.089653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b24a9-7903-427a-af73-098d5ff1ba85 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.145283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:05.146118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.146403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.146678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.163798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:05.165501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 372/723] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:05.173132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:05.175503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:05.177561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 352/724] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:05.183317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9be27e-036a-498a-a189-5a9a4b49eb9e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.187669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.290703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9be27e-036a-498a-a189-5a9a4b49eb9e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.332040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:05.332723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.333007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.333281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.334039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:05.334350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:05.335744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:05.359495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 373/725] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:05.364463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.383039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1557-4b72-45c5-b09a-f3dabf4d11f0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.427444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:05.429462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.431394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.431905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.456067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:05.483581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:05.484644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:05.485523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:05.492264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 353/726] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:05.497666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.583117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb93da4-e52b-477b-bd46-39c6f5c84fd9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.628578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8689ac8-86d3-47fa-8901-52b2d68aa97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:05.629795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8689ac8-86d3-47fa-8901-52b2d68aa97e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.630282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8689ac8-86d3-47fa-8901-52b2d68aa97e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.630760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8689ac8-86d3-47fa-8901-52b2d68aa97e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.642951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8689ac8-86d3-47fa-8901-52b2d68aa97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:05.644779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8689ac8-86d3-47fa-8901-52b2d68aa97e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:05.657907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998f46-6e28-4645-a94c-38a929deb2bc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-b8689ac8-86d3-47fa-8901-52b2d68aa97e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:05.663365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:05.664284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:05.665193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:05.665193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:05.665193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:05.665193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:05.667588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 374/727] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:05.669867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bec57-d117-41bc-a7c9-013243644669 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.670415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bec57-d117-41bc-a7c9-013243644669 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.670899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bec57-d117-41bc-a7c9-013243644669 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.673066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 375/728] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:05.673986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bec57-d117-41bc-a7c9-013243644669 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.697219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123aff-1183-495b-b077-918fa5bb488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:05.697927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123aff-1183-495b-b077-918fa5bb488e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.698210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123aff-1183-495b-b077-918fa5bb488e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.698485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123aff-1183-495b-b077-918fa5bb488e None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.699341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123aff-1183-495b-b077-918fa5bb488e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:05.699906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123aff-1183-495b-b077-918fa5bb488e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:05.701284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123aff-1183-495b-b077-918fa5bb488e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:05.710079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 354/729] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:05.711466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95c81-5018-44dd-a9a3-af4202e444d4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.711749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95c81-5018-44dd-a9a3-af4202e444d4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.712055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95c81-5018-44dd-a9a3-af4202e444d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.729424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-10d95c81-5018-44dd-a9a3-af4202e444d4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:05.731192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-10d95c81-5018-44dd-a9a3-af4202e444d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:05.788972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bec57-d117-41bc-a7c9-013243644669 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.804376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 355/730] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:41:05.805081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d95c81-5018-44dd-a9a3-af4202e444d4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.826411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:05.827784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.828341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.828816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.829783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:05.830291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:05.831894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:05.845558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 376/731] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:05.846809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:05.938075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d95c81-5018-44dd-a9a3-af4202e444d4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.955130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188899ee-054d-4845-bdf4-a8a920fe481e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:05.974842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:05.975660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:05.975977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:05.976327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:05.987352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:05.988888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.000137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.000882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.001170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.001456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.002232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.003684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:06.016301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:06.017997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:06.018899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:06.018899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:06.018899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:06.018899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:06.018899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 356/732] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:06.018899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.034496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 377/733] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:05 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:06.035394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.153090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767c0f-e16d-415b-9e4e-320b0873a0c4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:06.198447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f787-3287-49c6-a218-b565acc20aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.200375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f787-3287-49c6-a218-b565acc20aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.200877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f787-3287-49c6-a218-b565acc20aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.201463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f787-3287-49c6-a218-b565acc20aa0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.205444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952ca50-9569-4a4b-a84f-ecd5dbeb1534 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:06.210665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f787-3287-49c6-a218-b565acc20aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.212642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532f787-3287-49c6-a218-b565acc20aa0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3532f787-3287-49c6-a218-b565acc20aa0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:06.230565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:06.231706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:06.232748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:06.235554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 357/734] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:06.237160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec224be-3559-4f19-87b9-f09651750969 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.237695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec224be-3559-4f19-87b9-f09651750969 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.238169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec224be-3559-4f19-87b9-f09651750969 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.240044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 358/735] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:06.241009 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec224be-3559-4f19-87b9-f09651750969 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.250130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac9fd0-90bf-484c-b73a-7101e70cf510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.250831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9fd0-90bf-484c-b73a-7101e70cf510 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.251115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9fd0-90bf-484c-b73a-7101e70cf510 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.251393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac9fd0-90bf-484c-b73a-7101e70cf510 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.252273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac9fd0-90bf-484c-b73a-7101e70cf510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:06.252562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac9fd0-90bf-484c-b73a-7101e70cf510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.254050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac9fd0-90bf-484c-b73a-7101e70cf510 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.268964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 378/736] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:06.270677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1e30b-f4bd-4600-ae91-b03e6e14e01d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.271170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1e30b-f4bd-4600-ae91-b03e6e14e01d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.271459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1e30b-f4bd-4600-ae91-b03e6e14e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.289619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-22b1e30b-f4bd-4600-ae91-b03e6e14e01d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:06.290811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-22b1e30b-f4bd-4600-ae91-b03e6e14e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:06.373383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec224be-3559-4f19-87b9-f09651750969 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:06.374308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 379/737] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:41:06.375200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1e30b-f4bd-4600-ae91-b03e6e14e01d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.415452 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.417016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.417577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.418316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.419508 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:06.420370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.422489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.445532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 359/738] 10.222.0.99 () {56 vars in 1135 bytes} [Fri May 13 14:41:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:06.446821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.529219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1e30b-f4bd-4600-ae91-b03e6e14e01d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:06.561867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98e292-d075-4b28-9743-95c7d613991a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:06.571782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.572949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.573880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.574367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.584421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.586158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:06.605206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:06.606251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:06.607216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:06.607745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.607745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.607745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.607745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.608049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.609710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.610565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 380/739] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:41:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:06.611628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.631981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 360/740] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:06 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:06.633385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.807721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77522c7e-c238-45b5-9223-025cc726f41c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:06.852294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3551f9-4f20-49da-946b-65398d174229 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:06.875043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729790ca-31da-47c7-a576-36f528aa25d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.875711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729790ca-31da-47c7-a576-36f528aa25d9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.876036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729790ca-31da-47c7-a576-36f528aa25d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.876310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729790ca-31da-47c7-a576-36f528aa25d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.896823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cc798-0034-435e-869b-abb87658dff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:06.897496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc798-0034-435e-869b-abb87658dff1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.897779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc798-0034-435e-869b-abb87658dff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.898053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc798-0034-435e-869b-abb87658dff1 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.898896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc798-0034-435e-869b-abb87658dff1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:06.899206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc798-0034-435e-869b-abb87658dff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.900691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc798-0034-435e-869b-abb87658dff1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:06.921125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 361/741] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:41:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:06.922246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157269-092a-4dd3-bab9-9b719637358d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:06.922539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157269-092a-4dd3-bab9-9b719637358d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:06.922817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157269-092a-4dd3-bab9-9b719637358d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:06.925025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 362/742] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:06.927135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157269-092a-4dd3-bab9-9b719637358d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:06.960529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729790ca-31da-47c7-a576-36f528aa25d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:06.963152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729790ca-31da-47c7-a576-36f528aa25d9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.045376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157269-092a-4dd3-bab9-9b719637358d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.076426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 381/743] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:07.076426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9d4f-1390-4799-9e4e-badb404d654e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.076426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9d4f-1390-4799-9e4e-badb404d654e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.076426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9d4f-1390-4799-9e4e-badb404d654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.091327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.092403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.092859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.093277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.094676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-adcb9d4f-1390-4799-9e4e-badb404d654e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:07.096028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-adcb9d4f-1390-4799-9e4e-badb404d654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:07.105900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.108259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:07.131051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:07.132182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:07.133286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:07.133286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:07.133286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:07.133286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:07.135973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 363/744] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:07.137250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.180000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 382/745] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:07.181069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9d4f-1390-4799-9e4e-badb404d654e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.242022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef6424-fb0c-4d4d-baa8-eab0f42509e4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.276104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.277014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.277288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.277556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.287670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.289164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.299820 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9d4f-1390-4799-9e4e-badb404d654e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.342501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.343241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.343595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.343974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.344798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:07.345180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.346691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.360813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 383/746] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:07.361807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:07.436794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:07.437762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:07.438664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:07.438664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:07.438664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:07.438664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:07.438664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 364/747] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:07.439286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.467976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f2fe-e751-43ce-a07c-d7e506e15eca None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.502913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.503885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.504277 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.504653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.515712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:07.523506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:07.524678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:41:07.525609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:07.531727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 384/748] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:07.532630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.549240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b78e-9447-454a-9446-c4e52a8a1de9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.583115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.584265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.584748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.585194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.592165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.593874 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:07.607914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:07.608813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:07.609704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:07.612231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 365/749] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:07.613246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.633389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45b2e6-bc98-4278-9b34-f1b7389c2c2c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.667349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.668325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.668668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.669022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.669894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:07.670191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.671645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.688469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 385/750] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:07.689570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.713795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdea2a-b104-4346-a80c-d89c10b06918 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.747525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.748564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.749046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.749537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.750478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:07.750977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.752586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.761257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 366/751] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:07.762409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.794237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a455-021d-4d4a-9077-1b30ed57f077 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.830485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.831262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.831548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.831895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.833265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:07.833265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.834571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.848003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 386/752] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:07.848875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.865978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57c0e-b063-49cf-8dd0-96da55c645d1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.899975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.901151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.901661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.902147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:07.909376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:07.911087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:07.925952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:07.926883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:07.927767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:07.930278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 367/753] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:07.931314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:07.956246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cd05-6ea6-4514-a2ee-367a5ee8a09d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:07.991175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:07.992227 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:07.992410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:07.992670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.004481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.005962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:08.023528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:08.024561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:08.025451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:08.025451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:08.025451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:08.025451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:08.029637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 387/754] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:08.030501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:08.037132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eaaef-09a8-474b-ab1a-66350e0bfa20 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.071752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.073032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.073570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.074183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/38f74d30b6da44cb8f60e87f44da4ff5/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.076411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=38f74d30b6da44cb8f60e87f44da4ff5, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.078096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:08.094606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 368/755] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:41:07 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/38f74d30b6da44cb8f60e87f44da4ff5/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:41:08.096039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:08.135589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c8547-bf15-4ffb-8692-9c20b15e4bbd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.172833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.173524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.173808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.174146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.175053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:08.175392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.176943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:08.193957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 388/756] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:08.200794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:08.225672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fc60b-57e2-428e-be4b-3215d27469ba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.263711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.264085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.264374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.264650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.265398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:08.265706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.267137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:08.279792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 369/757] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:08.285453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:08.329554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f880-08df-40fa-9099-ea76edd02aec None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.365488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.366045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.366333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.366611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.367537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=6f71bb499b4e4f5cbb0caeee2d30387a) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:08.367911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.369378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:08.376535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 389/758] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:08 2022] GET /identity/v3/role_assignments?user.id=6f71bb499b4e4f5cbb0caeee2d30387a&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:08.409689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976417f-1e7e-4c1c-9e2c-a4cba9642959 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.447843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa2045-c39e-4cc7-9be8-fb6ad76e9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.449858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa2045-c39e-4cc7-9be8-fb6ad76e9009 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.450379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa2045-c39e-4cc7-9be8-fb6ad76e9009 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.450888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa2045-c39e-4cc7-9be8-fb6ad76e9009 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.460340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa2045-c39e-4cc7-9be8-fb6ad76e9009 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.462186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa2045-c39e-4cc7-9be8-fb6ad76e9009 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7faa2045-c39e-4cc7-9be8-fb6ad76e9009 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:08.478869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:08.480186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:08.481266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:08.484144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 370/759] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:41:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:08.490233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:08.580012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804db0-4768-4406-8a6e-f3e1dd006b9b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.580361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804db0-4768-4406-8a6e-f3e1dd006b9b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.580553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804db0-4768-4406-8a6e-f3e1dd006b9b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.581954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 371/760] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:08.592950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987b8c-9372-40fe-8a34-b319b92819dd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.593249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987b8c-9372-40fe-8a34-b319b92819dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.593509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987b8c-9372-40fe-8a34-b319b92819dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.623052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-99987b8c-9372-40fe-8a34-b319b92819dd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:08.624301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-99987b8c-9372-40fe-8a34-b319b92819dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:08.640431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f93050-c2d5-4986-8155-27ea8624faac None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.678899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.680358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.680834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.681245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.682429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:08.683268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.685187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:08.703030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 372/761] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:08.714742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 390/762] 10.222.0.99 () {56 vars in 1149 bytes} [Fri May 13 14:41:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:08.720240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987b8c-9372-40fe-8a34-b319b92819dd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:08.731787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:08.908542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987b8c-9372-40fe-8a34-b319b92819dd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.926434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17c688-8974-4d08-ad19-b950ac1a4c0b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:08.950890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412967c7-ab58-486a-a6ad-e4f7e7912226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.951899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412967c7-ab58-486a-a6ad-e4f7e7912226 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.952380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412967c7-ab58-486a-a6ad-e4f7e7912226 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.952842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412967c7-ab58-486a-a6ad-e4f7e7912226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.993324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a424c-234a-4691-818b-58c17e3005e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:08.994828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a424c-234a-4691-818b-58c17e3005e3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:08.995375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a424c-234a-4691-818b-58c17e3005e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:08.995910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a424c-234a-4691-818b-58c17e3005e3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:08.996764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a424c-234a-4691-818b-58c17e3005e3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:08.998361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a424c-234a-4691-818b-58c17e3005e3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-352a424c-234a-4691-818b-58c17e3005e3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:09.012968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:09.013946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:09.014780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:09.017826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 391/763] 10.222.0.99 () {56 vars in 1129 bytes} [Fri May 13 14:41:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:09.023896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4290a-1818-4ec5-b28b-fd1a8aa3b134 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.024452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4290a-1818-4ec5-b28b-fd1a8aa3b134 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.024925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4290a-1818-4ec5-b28b-fd1a8aa3b134 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.026708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 392/764] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:09.027627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4290a-1818-4ec5-b28b-fd1a8aa3b134 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.044740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412967c7-ab58-486a-a6ad-e4f7e7912226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.046373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412967c7-ab58-486a-a6ad-e4f7e7912226 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.143780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4290a-1818-4ec5-b28b-fd1a8aa3b134 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.170715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 373/765] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:09.172609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc020d-20c5-4d38-96e7-1d0b35ae8811 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.172900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc020d-20c5-4d38-96e7-1d0b35ae8811 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.173177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc020d-20c5-4d38-96e7-1d0b35ae8811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.178010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.178952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.179445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.180023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.180960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:09.181496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.183095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.192760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 393/766] 10.222.0.99 () {56 vars in 1124 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:09.193237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.194261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3cbc020d-20c5-4d38-96e7-1d0b35ae8811 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:09.195468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3cbc020d-20c5-4d38-96e7-1d0b35ae8811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:09.271188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 374/767] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:09.272526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc020d-20c5-4d38-96e7-1d0b35ae8811 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.323358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da265751-1cc0-4178-899c-f269dbdefc5e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.362644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.363812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.364322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.364798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.381432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.383245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.392831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc020d-20c5-4d38-96e7-1d0b35ae8811 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:09.409015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:09.409956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:09.410973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:09.410973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:09.410973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:09.410973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:09.413296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 394/768] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:09.414365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.427326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.428083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.428363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.428631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.429389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:09.429731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.431220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.441347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 375/769] 10.222.0.99 () {56 vars in 1124 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:09.441347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.529808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec24c8-a75b-432f-92ae-a44754c916cd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.563834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.565107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.565590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.566058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] PATH_INFO: `/v3/services/network` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.566920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.568566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.574223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de07730-1fa2-457b-a98e-804ffb54cfd9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:09.581537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:09.582505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:09.583323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:09.586149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 395/770] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:09.587228 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.619683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.620891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.621180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.621455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.622455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:09.622764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.624189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.639023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 376/771] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:09.640351 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.693553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285fb5-0efb-4256-bfd5-a169b7f6419b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.727453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.728324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.728680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.729065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.730179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] RBAC: Adding query filter params (interface=public, service_id=cfdbbd219d3b413cb8333403003bfd0a, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:09.730630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.732140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.741687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 396/772] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/endpoints?service_id=cfdbbd219d3b413cb8333403003bfd0a&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:09.743120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.763468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8ba6e-b897-4b5d-af21-1a3726ebaa8c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.808140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.808793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.809221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.809500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.810661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] RBAC: Adding query filter params (name=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:09.811084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.812949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.819956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 377/773] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:09.820803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:09.857939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f45f77-0fed-407d-90be-ca5b410aa400 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.891807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.892677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.892959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.893283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.899943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.901401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.935447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d46ed-0103-41bb-82d5-2d8cb74febed None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:09.973034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:09.973715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:09.973993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:09.974263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:09.974950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:09.976393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:09.982969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 378/774] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:09.983984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:10.042741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:10.045017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:10.046105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 397/775] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:10.056256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:10.094006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418d7b3-3f61-4dde-8dbc-f5a94abae9d2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:10.134786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:10.135498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.137033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.137318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.138045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:10.138353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:10.139753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:10.150906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 379/776] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:10.152467 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:10.269480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe5e95-6c72-4dce-8da0-7f0f9a4b7ac6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:10.310364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:10.311040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.311318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.311592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.312417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] RBAC: Adding query filter params (interface=public, service_id=f8d9c3bb3a054ffea28f882bdc5119ac, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:10.312727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:10.313854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9bfb-d7b7-4d88-9f4d-22945f91986f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:10.314110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:10.327826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 380/777] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:41:10 2022] GET /identity/v3/endpoints?service_id=f8d9c3bb3a054ffea28f882bdc5119ac&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:10.329463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:10.359801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:10.360433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.360718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.360988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.361772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:10.362074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:10.363500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:10.376131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 398/778] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:10.384904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:10.458534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4e0d-30f6-4cc1-bcf1-1df462398bcf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:10.500818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6361c-073e-47de-8fce-8513a97b8d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:10.501492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6361c-073e-47de-8fce-8513a97b8d77 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.501772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6361c-073e-47de-8fce-8513a97b8d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.502046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6361c-073e-47de-8fce-8513a97b8d77 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.502727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6361c-073e-47de-8fce-8513a97b8d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:10.504149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6361c-073e-47de-8fce-8513a97b8d77 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:10.513643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 381/779] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:10 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:10.514358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7199e-cde4-4878-85dd-9645d34c7abd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:10.568240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2a3ae-1da3-466c-a36c-af5724c6cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:10.568930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2a3ae-1da3-466c-a36c-af5724c6cb25 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.569213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2a3ae-1da3-466c-a36c-af5724c6cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.569490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2a3ae-1da3-466c-a36c-af5724c6cb25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.570428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2a3ae-1da3-466c-a36c-af5724c6cb25 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=37073a0901464b2393b6b8fa9d71b962) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:10.570798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2a3ae-1da3-466c-a36c-af5724c6cb25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:10.572434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2a3ae-1da3-466c-a36c-af5724c6cb25 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:10.579803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 399/780] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:10 2022] GET /identity/v3/role_assignments?user.id=37073a0901464b2393b6b8fa9d71b962&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:10.821007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aca06-63d6-42fb-b4ba-178034fe173d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.821408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aca06-63d6-42fb-b4ba-178034fe173d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.821589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aca06-63d6-42fb-b4ba-178034fe173d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.823101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 382/781] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:10.828802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b996e-905e-4ffe-a256-0bc2a4494cdf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.829092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b996e-905e-4ffe-a256-0bc2a4494cdf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.829371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b996e-905e-4ffe-a256-0bc2a4494cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.848064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1f0b996e-905e-4ffe-a256-0bc2a4494cdf None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:10.849239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1f0b996e-905e-4ffe-a256-0bc2a4494cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:10.915697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 400/782] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:10.938299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aca06-63d6-42fb-b4ba-178034fe173d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:10.951052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521110ec-43e9-494e-b630-8179c35d6279 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.951334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521110ec-43e9-494e-b630-8179c35d6279 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.951604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521110ec-43e9-494e-b630-8179c35d6279 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.953252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 401/783] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:10.960624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa99a06-8916-4f61-bb76-1676d83071a9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:10.960908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa99a06-8916-4f61-bb76-1676d83071a9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:10.961190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa99a06-8916-4f61-bb76-1676d83071a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:10.996213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1aa99a06-8916-4f61-bb76-1676d83071a9 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:10.997400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1aa99a06-8916-4f61-bb76-1676d83071a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:11.112486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 402/784] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:11.128968 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aca06-63d6-42fb-b4ba-178034fe173d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:11.133455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa99a06-8916-4f61-bb76-1676d83071a9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:11.186008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:11.186863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:11.187146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:11.187416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:11.203666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:11.220178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:11.221174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:11.222033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 383/785] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:11.232891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:11.241046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa99a06-8916-4f61-bb76-1676d83071a9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:11.285553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:11.286371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:11.286658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:11.286932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:11.310366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:11.318391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:11.320626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:11.322591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:11.328217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 403/786] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:11.337381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:11.384676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d023d-3653-468a-9ad0-aa195d626fc7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:11.428977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:11.429656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:11.429934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:11.430211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:11.430972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:11.431277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:11.432736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:11.449741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 384/787] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:11.456234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:11.571168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6810-7a53-4a03-aa0d-fbdf01e1620b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:11.580099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfb844-54ba-4007-9610-983130453a6b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:11.619218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:11.620419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:11.620930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:11.621417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:11.634030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:11.635947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:11.644631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:11.645370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:11.645653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:11.645923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:11.646678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:11.646979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:11.648378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:11.655846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:11.656747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:11.657745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:11.657745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:11.657745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:11.657745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:11.663933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 385/788] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:11.665424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:11.666353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 404/789] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:11.672030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:11.762438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012d925-36e1-4900-98fe-a0c635e84a89 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:11.794758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:11.795711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:11.796243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:11.796708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:11.797620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:11.798117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:11.799681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:11.811739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 386/790] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:11.817333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:11.860468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78ba3-710a-4df8-b9b9-21f92dc9903f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:11.895551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:11.896675 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:11.897127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:11.897971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:11.908996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:11.910721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:11.932446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:11.933416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:11.934331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:11.934331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:11.934331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:11.934331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:11.936508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 405/791] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:11.943304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:12.024051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179bb1-753c-4285-a26e-2dcd804c676b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:12.082571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:12.083363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:12.083641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:12.083930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:12.097650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:12.099109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:12.119666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:12.120907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:12.121857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:12.122926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba65ee-0bbc-4ecd-b3ed-f4a5032353db None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:12.131722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 387/792] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:12.138486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:12.177859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:12.178448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:12.178726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:12.178997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:12.179720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:12.180072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:12.181430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:12.204290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 406/793] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:12.205195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:12.313690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7452087-a733-4bd6-b54d-4ccc347a6253 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:12.370706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:12.371375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:12.371651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:12.371945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:12.372781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:12.373089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:12.374523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:12.387464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc0faa-a70e-4d4a-9675-49fd72ad124b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:12.396315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 388/794] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:41:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:12.397736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:12.488588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:12.489401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:12.489684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:12.489955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:12.501737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976245-3f7a-4441-9a47-430669aa8950 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:12.505859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:12.507328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:12.539739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:12.540771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:12.541709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 407/795] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:12.542354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:12.542354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:12.542354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:12.542702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:12.548824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:12.634464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:12.636854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:12.778433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 389/796] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:41:12.784200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:12.884323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28feec-e648-4f62-a6bd-b033b8485145 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:12.917531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d198f-8d43-4047-8610-18d2f62eb8d2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:12.917827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdfba4-ff66-4da7-82db-5e9cbb67141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:12.918428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdfba4-ff66-4da7-82db-5e9cbb67141f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:12.918705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdfba4-ff66-4da7-82db-5e9cbb67141f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:12.918976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdfba4-ff66-4da7-82db-5e9cbb67141f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:12.929305 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdfba4-ff66-4da7-82db-5e9cbb67141f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:12.930782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdfba4-ff66-4da7-82db-5e9cbb67141f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8dbdfba4-ff66-4da7-82db-5e9cbb67141f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:12.948633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:12.949746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:12.950707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:12.950707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:12.950707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:12.950707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:12.950707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 390/797] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:12.951416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eee22-8ca1-4e40-b0ca-97e03b93311d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:12.951646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eee22-8ca1-4e40-b0ca-97e03b93311d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:12.956477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eee22-8ca1-4e40-b0ca-97e03b93311d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:12.961746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 391/798] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:12.961746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eee22-8ca1-4e40-b0ca-97e03b93311d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.001598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd48e51-5cd9-4b7f-8419-47df771b351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.002301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd48e51-5cd9-4b7f-8419-47df771b351e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.002584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd48e51-5cd9-4b7f-8419-47df771b351e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.002859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd48e51-5cd9-4b7f-8419-47df771b351e None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.003720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd48e51-5cd9-4b7f-8419-47df771b351e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:13.004067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd48e51-5cd9-4b7f-8419-47df771b351e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.005552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd48e51-5cd9-4b7f-8419-47df771b351e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.036429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 408/799] 10.222.0.99 () {56 vars in 1135 bytes} [Fri May 13 14:41:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:13.038095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374d6b-4646-4dcb-b5ae-77805b576cde None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.038581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374d6b-4646-4dcb-b5ae-77805b576cde None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.039069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374d6b-4646-4dcb-b5ae-77805b576cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.061051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-fd374d6b-4646-4dcb-b5ae-77805b576cde None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:13.062275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fd374d6b-4646-4dcb-b5ae-77805b576cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:13.123295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eee22-8ca1-4e40-b0ca-97e03b93311d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.171928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 409/800] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:13.171928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374d6b-4646-4dcb-b5ae-77805b576cde None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.193430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be538a1-410d-4aca-bc60-bfecd89ecc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.194102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be538a1-410d-4aca-bc60-bfecd89ecc82 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.194379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be538a1-410d-4aca-bc60-bfecd89ecc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.196350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be538a1-410d-4aca-bc60-bfecd89ecc82 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.197076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be538a1-410d-4aca-bc60-bfecd89ecc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:13.197382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be538a1-410d-4aca-bc60-bfecd89ecc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.198842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be538a1-410d-4aca-bc60-bfecd89ecc82 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.211087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 392/801] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:13.217635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33132b2-a824-4221-852f-70f9506c915b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.220112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33132b2-a824-4221-852f-70f9506c915b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.220427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33132b2-a824-4221-852f-70f9506c915b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.225166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 393/802] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:13.225166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33132b2-a824-4221-852f-70f9506c915b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.294749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374d6b-4646-4dcb-b5ae-77805b576cde None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.323907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33132b2-a824-4221-852f-70f9506c915b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.326073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.326871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.327144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.327412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.337012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.338466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:13.355682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:13.356660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:13.358185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:13.358185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:13.358185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:13.358185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:13.358185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 410/803] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:13.358185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.358539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab875a93-8507-4465-897c-fdf0a094e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.359258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875a93-8507-4465-897c-fdf0a094e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.359459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875a93-8507-4465-897c-fdf0a094e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.359725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875a93-8507-4465-897c-fdf0a094e1d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.360409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab875a93-8507-4465-897c-fdf0a094e1d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.361758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab875a93-8507-4465-897c-fdf0a094e1d1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ab875a93-8507-4465-897c-fdf0a094e1d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:13.373804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:13.374932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:13.375858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 394/804] 10.222.0.99 () {56 vars in 1129 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:13.376838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679a9a-8ba1-440e-8ed2-ae6c5edb161e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.376838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679a9a-8ba1-440e-8ed2-ae6c5edb161e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.376838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679a9a-8ba1-440e-8ed2-ae6c5edb161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.392820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b2679a9a-8ba1-440e-8ed2-ae6c5edb161e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:13.393976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2679a9a-8ba1-440e-8ed2-ae6c5edb161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:13.453265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e05d5a-39ce-4185-894f-316715d89c29 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.458572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 395/805] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:13.460026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153d0c8-6d6b-42f7-844d-4a5ae4dbd9dd None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.460308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153d0c8-6d6b-42f7-844d-4a5ae4dbd9dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.460604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153d0c8-6d6b-42f7-844d-4a5ae4dbd9dd None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.461989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 396/806] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:13.462528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153d0c8-6d6b-42f7-844d-4a5ae4dbd9dd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.490965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.491760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.492061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.492331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.499071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.500538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:13.514069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:13.514976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:13.515858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 411/807] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:13.516378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.561386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153d0c8-6d6b-42f7-844d-4a5ae4dbd9dd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.594066 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883c1b-35a5-4765-82ff-36eccb3ede52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.594726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883c1b-35a5-4765-82ff-36eccb3ede52 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.595000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883c1b-35a5-4765-82ff-36eccb3ede52 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.595268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883c1b-35a5-4765-82ff-36eccb3ede52 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.596018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5883c1b-35a5-4765-82ff-36eccb3ede52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:13.596320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5883c1b-35a5-4765-82ff-36eccb3ede52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.598025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5883c1b-35a5-4765-82ff-36eccb3ede52 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.609517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 397/808] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:13.610709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bca370-c82f-4ae3-9ce5-6ba51fa5fa36 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.610994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bca370-c82f-4ae3-9ce5-6ba51fa5fa36 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.611267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bca370-c82f-4ae3-9ce5-6ba51fa5fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.612140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8be0f-50e2-4ce4-99a6-0178a36555c9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.628308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-70bca370-c82f-4ae3-9ce5-6ba51fa5fa36 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:13.629486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-70bca370-c82f-4ae3-9ce5-6ba51fa5fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:13.644010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.644681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.644968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.645240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.645948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:13.646248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.647608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.652271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 412/809] 10.222.0.99 () {56 vars in 1124 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:13.653101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.692146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 398/810] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:13.692977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bca370-c82f-4ae3-9ce5-6ba51fa5fa36 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.765534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1389ae-f715-48ce-950b-51e4f123f2d3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.784828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bca370-c82f-4ae3-9ce5-6ba51fa5fa36 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.799010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.799813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.800122 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.800394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] PATH_INFO: `/v3/services/network` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.801040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.802398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:13.814699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:13.815801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:13.817016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 413/811] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:13.817891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.820735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.821641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.821788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.821973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.822758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:13.823109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.824847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.841730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 399/812] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:13.841730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.918767 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb924-c3cc-435c-a347-ebb231c4cd39 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.933758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef63f7-d915-4ba0-b341-0486da7b8816 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:13.956911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.957724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.958000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.958269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.965653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.965933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:13.966621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:13.966908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:13.967065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.967165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:13.967913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:13.968212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:13.969587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:13.974573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 400/813] 10.222.0.99 () {56 vars in 1124 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:13.975336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:13.982337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:13.983338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:13.984258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:13.988259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 414/814] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:13.988865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.072603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d1086-18aa-4b7d-ab53-da28d8250434 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.082600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cabdb-e931-4b04-8f36-3a0353a1bbec None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.105882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.106686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.106965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.107242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.115721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.116448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.116726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.116997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.117442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:14.117693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:14.117992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.119344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.123788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 415/815] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:14.124629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:14.125737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:14.127259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 401/816] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:41:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:14.128417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.223430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5335f-cc7f-47ce-8bdd-643f99f01be2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.224033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f376f-92e1-4d9f-b47b-59e6e214fab0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.255041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.255407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.255692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.256000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.256100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.256275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.256387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.256624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.257102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=38f74d30b6da44cb8f60e87f44da4ff5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:14.257359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.257448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.258824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.258919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.264644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 416/817] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:14 2022] GET /identity/v3/role_assignments?user.id=38f74d30b6da44cb8f60e87f44da4ff5&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:14.265411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.284475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 402/818] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:14.285759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.381940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c6e6-2159-4654-82d8-1c2474980fbc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.432253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.433109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.433395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.433858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.435083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:14.435402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.436955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.451976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728bb84-4699-4ee5-9abd-650fe883ded1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.460104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 417/819] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:14.461096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.490844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.491529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.491995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.492193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.492820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] RBAC: Adding query filter params (type=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:14.493126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.494516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.499801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 403/820] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:14.500700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.575630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715fc9-6e30-407c-95c3-8760daf10609 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.610532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.611205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.611482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.611752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.612512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e998587-fa07-4ee5-b212-6fb62ab2b45c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.612625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:14.612823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.614188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.622918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 418/821] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:41:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:14.623741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.646095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.646914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.647236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.647515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/6f71bb499b4e4f5cbb0caeee2d30387a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.649525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=6f71bb499b4e4f5cbb0caeee2d30387a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.650997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.665686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 404/822] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:41:14 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/6f71bb499b4e4f5cbb0caeee2d30387a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:41:14.666634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:14.742241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a68b-8e1d-469a-9a09-52db48364e56 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.779810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.780600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.780888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.781164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.781958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.783420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.806722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 419/823] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:14.848142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe3e07-d79b-44fb-90ef-d375fec46761 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:14.900341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:14.901101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:14.901598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:14.901948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:14.914240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:14.915791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:14.935177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:14.937322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:14.939303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:14.939303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:14.939303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:14.939303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:14.939303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 405/824] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:14.942449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:15.053902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211de54-4d59-4c95-a5c0-77443939d3b2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:15.088055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:15.088787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:15.089072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:15.089348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:15.090078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:15.090385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:15.091763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:15.104783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 420/825] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:15.110265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:15.215652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737cfa1-1baf-40be-bd78-b4c8dd068c6b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:15.250348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:15.251167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:15.251450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:15.251724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:15.259639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:15.261257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:15.275962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:15.276963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:15.277888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 406/826] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:41:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:15.283151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:15.385244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ee43c-024e-4601-bb6a-7c7bc34f1bb3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:15.421019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:15.421696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:15.421979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:15.422252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:15.423080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:15.423385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:15.424848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:15.442282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 421/827] 10.222.0.99 () {56 vars in 1149 bytes} [Fri May 13 14:41:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:15.447680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:15.561426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f344db3-244e-4660-9fe0-051eb1d38a2e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:15.595505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:15.596341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:15.596623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:15.597207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:15.608225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:15.609694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:15.626796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:15.627712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:15.628632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:15.628632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:15.628632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:15.628632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:15.628632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 407/828] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:15.633882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:15.737373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ad7c0-30f3-4a6e-8c2f-6b8552e3c9e5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:15.770936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:15.771532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:15.771814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:15.772120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:15.772846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:15.773151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:15.774527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:15.786603 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 422/829] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:15.792012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:15.891915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecd553-9820-4c1f-bef2-d7c0ca6e7d9c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:15.924383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:15.925185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:15.925459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:15.925726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:15.932550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:15.934000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:15.948698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:15.950686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:15.952750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 408/830] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:15.960791 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:16.062258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4990-d165-4185-b02d-ada4a1709285 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:16.096413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4855f-cd3b-4d64-b0d8-87d34908cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:16.097393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4855f-cd3b-4d64-b0d8-87d34908cdfa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:16.097673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4855f-cd3b-4d64-b0d8-87d34908cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:16.097948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4855f-cd3b-4d64-b0d8-87d34908cdfa None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:16.098741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4855f-cd3b-4d64-b0d8-87d34908cdfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:16.099048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4855f-cd3b-4d64-b0d8-87d34908cdfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:16.100573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4855f-cd3b-4d64-b0d8-87d34908cdfa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:16.113429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 423/831] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:16.119138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:16.218182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1efa-3ff6-4c41-a4d9-aa2dfdfa4fec None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:16.252589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6817b8e-c7b2-4ff4-aca4-15c2cf14a8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:16.253485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6817b8e-c7b2-4ff4-aca4-15c2cf14a8eb None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:16.253766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6817b8e-c7b2-4ff4-aca4-15c2cf14a8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:16.254119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6817b8e-c7b2-4ff4-aca4-15c2cf14a8eb None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/37073a0901464b2393b6b8fa9d71b962/roles/2a865ee865184972b66c89d62f6071fd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:16.268654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6817b8e-c7b2-4ff4-aca4-15c2cf14a8eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=37073a0901464b2393b6b8fa9d71b962, role_id=2a865ee865184972b66c89d62f6071fd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:16.270113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6817b8e-c7b2-4ff4-aca4-15c2cf14a8eb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:16.284155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 409/832] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:41:16 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/37073a0901464b2393b6b8fa9d71b962/roles/2a865ee865184972b66c89d62f6071fd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:41:16.709710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd609-b59e-4424-acd8-06e759175aac None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:16.710499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd609-b59e-4424-acd8-06e759175aac None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:16.710499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd609-b59e-4424-acd8-06e759175aac None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:16.711794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 424/833] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:16.719614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e3aa-b53e-474c-9855-246b16a0a1ac None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:16.719614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e3aa-b53e-474c-9855-246b16a0a1ac None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:16.719614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e3aa-b53e-474c-9855-246b16a0a1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:16.736952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-09e4e3aa-b53e-474c-9855-246b16a0a1ac None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:16.738479 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-09e4e3aa-b53e-474c-9855-246b16a0a1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:16.795616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b023ad-f0b5-4df3-957a-bf500f111938 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:16.795808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b023ad-f0b5-4df3-957a-bf500f111938 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:16.796213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b023ad-f0b5-4df3-957a-bf500f111938 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:16.797876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 425/834] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:16.804140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f3ab0-0420-44cc-8309-8c90298677e3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:16.804424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f3ab0-0420-44cc-8309-8c90298677e3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:16.804701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f3ab0-0420-44cc-8309-8c90298677e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:16.812966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 410/835] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:16.829031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f55f3ab0-0420-44cc-8309-8c90298677e3 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:16.830573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f55f3ab0-0420-44cc-8309-8c90298677e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:16.836328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4e3aa-b53e-474c-9855-246b16a0a1ac None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:16.903707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 426/836] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:16.925775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f3ab0-0420-44cc-8309-8c90298677e3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:16.959066 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4e3aa-b53e-474c-9855-246b16a0a1ac None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:16.993738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:16.995191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:16.996049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:16.996546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:16.997464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:16.999108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:17.011657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:17.012827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:17.013753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:17.016791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 411/837] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:17.022178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:17.037488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f3ab0-0420-44cc-8309-8c90298677e3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.081708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.083557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.084181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.084666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.086028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:17.088195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:17.106654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:17.108724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:17.109565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:17.114284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 427/838] 10.222.0.99 () {56 vars in 1132 bytes} [Fri May 13 14:41:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:17.115161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:17.137838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be458d-e2e3-49b7-8ffb-dd1f4954b334 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.170364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37bd83-66f0-4c79-aead-b52eb20604d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.171041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bd83-66f0-4c79-aead-b52eb20604d7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.171319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bd83-66f0-4c79-aead-b52eb20604d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.171588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bd83-66f0-4c79-aead-b52eb20604d7 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.172318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37bd83-66f0-4c79-aead-b52eb20604d7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:17.172622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37bd83-66f0-4c79-aead-b52eb20604d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:17.174001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37bd83-66f0-4c79-aead-b52eb20604d7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.183067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 412/839] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:17.183067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57bb24-2db0-4d2b-87d4-2040fcc1855f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.183067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57bb24-2db0-4d2b-87d4-2040fcc1855f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.183067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57bb24-2db0-4d2b-87d4-2040fcc1855f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.183067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 413/840] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:17.183861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57bb24-2db0-4d2b-87d4-2040fcc1855f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:17.219948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a239ead-84ce-481c-8083-6095875aa350 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.252848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cd86e-facb-4ab0-9209-a948114dea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.253517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd86e-facb-4ab0-9209-a948114dea0e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.253800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd86e-facb-4ab0-9209-a948114dea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.254078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd86e-facb-4ab0-9209-a948114dea0e None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.254786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd86e-facb-4ab0-9209-a948114dea0e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:17.255095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd86e-facb-4ab0-9209-a948114dea0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:17.256506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd86e-facb-4ab0-9209-a948114dea0e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.261055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 428/841] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:17.262249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea0376-c8db-414f-a050-e7fc5e55caee None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.262537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea0376-c8db-414f-a050-e7fc5e55caee None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.262814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea0376-c8db-414f-a050-e7fc5e55caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.279038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-72ea0376-c8db-414f-a050-e7fc5e55caee None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:17.280285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-72ea0376-c8db-414f-a050-e7fc5e55caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:17.290960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57bb24-2db0-4d2b-87d4-2040fcc1855f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.323498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.324210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.324492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.324768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.325473 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:17.325777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:17.327177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.331521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 414/842] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:17.340323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:17.364892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 429/843] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:17.391709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea0376-c8db-414f-a050-e7fc5e55caee None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:17.499042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e6f5-1deb-43bd-9036-153508ad7dc5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.503432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea0376-c8db-414f-a050-e7fc5e55caee None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.546557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.546900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.547172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.547444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.548732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.549259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.550088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.550088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.550488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:17.550812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:17.552213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.557099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 415/844] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:17.561444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:17.570648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:17.571664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:17.573193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 430/845] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:17.580703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:17.691998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8747d3d-e045-4d1d-ab6a-040ea44f406a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.729253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.730405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.730915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.731384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.732477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:17.732990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:17.734635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.744283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 416/846] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:17.750596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:17.852139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20549f-0dea-45e9-a696-6fc120784e00 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:17.887949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:17.888756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:17.889032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:17.889303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:17.899898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:17.901429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:17.918394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:17.919349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:17.920290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:17.920290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:17.920290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:17.920290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:17.920290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 431/847] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:17.926832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:18.027851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccaee2-71f4-4094-a850-05ab307c40ef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:18.062437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:18.063463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.063973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.064465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.065390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:18.065918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:18.067518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:18.080357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 417/848] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:18.086128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:18.185601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b192d97-6327-4e85-91e6-4acfa167b3bd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:18.218906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:18.220108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.220593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.221063 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.229610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:18.231375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:18.245772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:18.246759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:41:18.247730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:18.250331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 432/849] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:18.256216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:18.357287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af047d-2c30-4590-a039-75c4a79643ee None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:18.393628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907379-8afd-4c29-8d5e-709f09aa24c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:18.394705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907379-8afd-4c29-8d5e-709f09aa24c1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.395210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907379-8afd-4c29-8d5e-709f09aa24c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.395699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907379-8afd-4c29-8d5e-709f09aa24c1 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.396883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907379-8afd-4c29-8d5e-709f09aa24c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:18.397439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907379-8afd-4c29-8d5e-709f09aa24c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:18.399146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907379-8afd-4c29-8d5e-709f09aa24c1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:18.420257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 418/850] 10.222.0.99 () {56 vars in 1135 bytes} [Fri May 13 14:41:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:18.426215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:18.532722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d01fe-97d4-4f99-b3cb-82e66937477f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:18.565599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:18.566280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.566555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.566827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.590550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c90ab-ab9f-429b-a8b7-62e47ed32f22 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.591122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c90ab-ab9f-429b-a8b7-62e47ed32f22 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.591596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c90ab-ab9f-429b-a8b7-62e47ed32f22 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.593660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 419/851] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:18.599154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089c3b4-a782-4a9e-aa85-463b965fa207 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.599675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089c3b4-a782-4a9e-aa85-463b965fa207 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.600266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089c3b4-a782-4a9e-aa85-463b965fa207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.616996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2089c3b4-a782-4a9e-aa85-463b965fa207 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:18.618566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2089c3b4-a782-4a9e-aa85-463b965fa207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:18.633102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:18.634558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:18.703911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 420/852] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:18.735817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089c3b4-a782-4a9e-aa85-463b965fa207 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:18.749544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 433/853] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:18.754808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:18.865377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089c3b4-a782-4a9e-aa85-463b965fa207 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:18.866916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56112ec-87fe-43dd-9bf9-4384564d0e70 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:18.901238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:18.901968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.902243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.902525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.906924 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:18.907927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:18.908361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:18.908803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:18.912677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:18.914022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:18.922776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:18.931403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:18.932650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:41:18.933762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:18.934415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:18.935321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:18.936438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:18.936438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:18.936438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:18.936438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:18.936438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 434/854] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:18.938140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 421/855] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:41:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:18.942997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:18.944667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.049414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c32b0-1d49-49f2-aec1-18f6e7179dbc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.062510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f555b-ffb5-4638-bbf6-27ce36e63ec7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.091004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.091938 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.092221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.092492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.093396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:19.093763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.096055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.103703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.109877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.110029 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 422/856] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:41:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:19.110131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.110131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.110131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:19.110131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.110895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.112875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.123243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 435/857] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:19.128532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.225702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c311-32e9-461b-bc9e-9969a3b8faf9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.259493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e79f3-1f73-4a99-aa14-b0139aa3b341 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.260765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.261654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.262004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.262262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.273186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.274711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:19.292494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:19.293432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:19.294332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:19.294332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:19.294332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:19.294332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:19.298665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 423/858] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:19.299640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.302526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.304442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.304565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.304750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.316819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.319346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:19.338956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:19.339967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:19.340875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:19.343854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 436/859] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:19.349966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.416356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a98d0-a02a-4a04-b321-2593eefd3c5a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.459008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.459686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.460000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.460409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.461148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:19.461456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.463223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.483164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353265d8-ad7e-499a-8f72-055a7bf53968 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.487907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 424/860] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:19.490053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.525806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.526634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.527443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.528202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.529005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:19.529377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.530896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.550794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 437/861] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:19.552013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.606084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1337eb-71ea-4b83-ba72-db5550c5a7cc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.640657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ed2e6-b594-4d75-adb3-64e0923bc2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.641566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ed2e6-b594-4d75-adb3-64e0923bc2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.641825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ed2e6-b594-4d75-adb3-64e0923bc2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.642122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ed2e6-b594-4d75-adb3-64e0923bc2f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.649299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ed2e6-b594-4d75-adb3-64e0923bc2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.650773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ed2e6-b594-4d75-adb3-64e0923bc2f7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.655844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944e969-36c3-4692-9314-a6cb7ef5d511 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-270ed2e6-b594-4d75-adb3-64e0923bc2f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:19.665830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:19.667032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:19.668023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:19.671719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 425/862] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:19.673065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a274e-317f-42ca-a15c-a40143bea15a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.673354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a274e-317f-42ca-a15c-a40143bea15a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.673626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a274e-317f-42ca-a15c-a40143bea15a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.675021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 426/863] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:19.675578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a274e-317f-42ca-a15c-a40143bea15a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.691834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768790-3d77-4cc9-b796-5278347308a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.692533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768790-3d77-4cc9-b796-5278347308a2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.692816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768790-3d77-4cc9-b796-5278347308a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.693089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768790-3d77-4cc9-b796-5278347308a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.693922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768790-3d77-4cc9-b796-5278347308a2 None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=6f71bb499b4e4f5cbb0caeee2d30387a) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:19.694232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768790-3d77-4cc9-b796-5278347308a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.695661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768790-3d77-4cc9-b796-5278347308a2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.710788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 438/864] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/role_assignments?user.id=6f71bb499b4e4f5cbb0caeee2d30387a&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:19.710788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d63076-24d1-4287-84b6-ca13fec6f3f1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.710788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d63076-24d1-4287-84b6-ca13fec6f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.710788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d63076-24d1-4287-84b6-ca13fec6f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.732111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b2d63076-24d1-4287-84b6-ca13fec6f3f1 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:19.733884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b2d63076-24d1-4287-84b6-ca13fec6f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:19.799204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a274e-317f-42ca-a15c-a40143bea15a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.829690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 439/865] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:19.845420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.846165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.846448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:19.847086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:19.848050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:19.848412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:19.849958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:19.855492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d63076-24d1-4287-84b6-ca13fec6f3f1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.872846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 427/866] 10.222.0.99 () {56 vars in 1149 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:19.878617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:19.966076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d63076-24d1-4287-84b6-ca13fec6f3f1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.991675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2f0a1-8c19-4187-be64-9689bda2384c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:19.998764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092dc8c-df7b-48ef-bfbd-e227f76a5008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:19.999432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092dc8c-df7b-48ef-bfbd-e227f76a5008 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:19.999717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092dc8c-df7b-48ef-bfbd-e227f76a5008 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.000012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092dc8c-df7b-48ef-bfbd-e227f76a5008 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.000744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092dc8c-df7b-48ef-bfbd-e227f76a5008 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:20.002096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092dc8c-df7b-48ef-bfbd-e227f76a5008 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:20.015364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 440/867] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:19 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:41:20.016926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048953-21d2-4b70-b43f-6ff8a2d52180 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.017299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048953-21d2-4b70-b43f-6ff8a2d52180 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.017670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048953-21d2-4b70-b43f-6ff8a2d52180 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.019165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 441/868] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:20.025215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3797a-b423-4aab-a830-90367a1fec75 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.025532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3797a-b423-4aab-a830-90367a1fec75 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.025885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3797a-b423-4aab-a830-90367a1fec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.046629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:20.047310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.047722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.048067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.049164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0db3797a-b423-4aab-a830-90367a1fec75 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:20.050634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0db3797a-b423-4aab-a830-90367a1fec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:20.122358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:20.123971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:20.143697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 442/869] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:20.168896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3797a-b423-4aab-a830-90367a1fec75 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:20.249264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 428/870] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:19 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:20.254456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:20.288628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3797a-b423-4aab-a830-90367a1fec75 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:20.325098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:20.325769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.326045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.326320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.327051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:20.328459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:20.355900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 443/871] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:20 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:20.378865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9cb3-72e8-400f-81af-95201ed39ba4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:20.423262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:20.424152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.424429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.424697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.437060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:20.438976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:20.459202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:20.460211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:20.461110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:20.461110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:20.461110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:20.461110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:20.461110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 429/872] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:20.466587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:20.584210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f7ae-5b7d-491f-9e64-d0672af0dd41 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:20.621585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:20.622555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.622840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.623119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.623863 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:20.624204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:20.625601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:20.638264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 444/873] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:20.643796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:20.741850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1945-2b36-41c5-ac07-0fab668ad9f0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:20.774844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:20.775587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.775964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.776197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.783093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:20.784573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:20.798193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:20.799107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:20.800044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 430/874] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:20.805350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:20.906716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78195c93-893e-4295-a325-cc33579666c5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:20.944531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dce05-d378-4ad2-a271-ca3e19a4b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:20.945632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dce05-d378-4ad2-a271-ca3e19a4b6cf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:20.946139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dce05-d378-4ad2-a271-ca3e19a4b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:20.946606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dce05-d378-4ad2-a271-ca3e19a4b6cf None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:20.947617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dce05-d378-4ad2-a271-ca3e19a4b6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:20.948240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dce05-d378-4ad2-a271-ca3e19a4b6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:20.949868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dce05-d378-4ad2-a271-ca3e19a4b6cf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:20.963670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 445/875] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:20.975925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:21.068664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590533c-6681-4dbf-8668-bbfc95cc179c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:21.101445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3522157-b623-4112-a767-8959f64d44da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:21.102103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522157-b623-4112-a767-8959f64d44da None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:21.102387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522157-b623-4112-a767-8959f64d44da None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:21.102662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3522157-b623-4112-a767-8959f64d44da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:21.103556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3522157-b623-4112-a767-8959f64d44da None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=37073a0901464b2393b6b8fa9d71b962) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:21.103978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3522157-b623-4112-a767-8959f64d44da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:21.105604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3522157-b623-4112-a767-8959f64d44da None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:21.112130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 431/876] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:20 2022] GET /identity/v3/role_assignments?user.id=37073a0901464b2393b6b8fa9d71b962&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:22.055579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8274833-aeb6-4526-a3aa-4a113e054367 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.056645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8274833-aeb6-4526-a3aa-4a113e054367 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.057182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8274833-aeb6-4526-a3aa-4a113e054367 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.059070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 446/877] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:22.064917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcf54-9021-42e9-bff5-135cf3370c86 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.065760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcf54-9021-42e9-bff5-135cf3370c86 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.066248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcf54-9021-42e9-bff5-135cf3370c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.083201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fb1dcf54-9021-42e9-bff5-135cf3370c86 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:22.084736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fb1dcf54-9021-42e9-bff5-135cf3370c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:22.155474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 432/878] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:22.177638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8274833-aeb6-4526-a3aa-4a113e054367 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.285259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8274833-aeb6-4526-a3aa-4a113e054367 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:22.318641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:22.319396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.319673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.319969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.320644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:22.322064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:22.328836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d01c-1754-47ff-9087-71a8bb823c9e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.329160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d01c-1754-47ff-9087-71a8bb823c9e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.329393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7d01c-1754-47ff-9087-71a8bb823c9e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.332562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 433/879] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:22.335248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:22.336298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:22.337131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 447/880] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:22.337942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c61f-4d8a-43e3-b921-c99095756b77 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.337942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c61f-4d8a-43e3-b921-c99095756b77 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.337942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c61f-4d8a-43e3-b921-c99095756b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.345026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.357929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0d48c61f-4d8a-43e3-b921-c99095756b77 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:22.359422 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d48c61f-4d8a-43e3-b921-c99095756b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:22.440834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 434/881] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:22.459646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed7ab-7cce-473a-912b-d3ebc652bfbf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:22.463468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c61f-4d8a-43e3-b921-c99095756b77 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:22.507162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.507623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.508093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.509002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:22.509997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:22.512105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:22.520423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 448/882] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:22.526457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.573780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c61f-4d8a-43e3-b921-c99095756b77 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:22.607909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:22.608865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.609031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.609284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.609916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:22.611356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:22.624017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:22.625035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:22.625861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 435/883] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:22.631310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.665452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf86c8e-6075-49bf-8c3c-cb57fc30ca32 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:22.699958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eb54e-bf79-4ffa-9bc3-4924fccff652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:22.700658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eb54e-bf79-4ffa-9bc3-4924fccff652 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.700941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eb54e-bf79-4ffa-9bc3-4924fccff652 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.701215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eb54e-bf79-4ffa-9bc3-4924fccff652 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.701932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78eb54e-bf79-4ffa-9bc3-4924fccff652 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:22.702237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78eb54e-bf79-4ffa-9bc3-4924fccff652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:22.703655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78eb54e-bf79-4ffa-9bc3-4924fccff652 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:22.708104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 449/884] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:22.709411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6855d7-6caa-4a75-993e-d0d0dc185ed5 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.709698 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6855d7-6caa-4a75-993e-d0d0dc185ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.709974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6855d7-6caa-4a75-993e-d0d0dc185ed5 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.715500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 450/885] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:22.722042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eefc3e-98af-4779-a29e-ed9af45b21b0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.722432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eefc3e-98af-4779-a29e-ed9af45b21b0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.722597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eefc3e-98af-4779-a29e-ed9af45b21b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.740422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-95eefc3e-98af-4779-a29e-ed9af45b21b0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:22.741643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-95eefc3e-98af-4779-a29e-ed9af45b21b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:22.748753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863920e1-ccdd-4229-a6a4-f399be437256 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:22.799574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:22.800455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.800946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.801236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.802308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:22.802661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:22.804839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:22.816839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 436/886] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:22.818864 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.832392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 451/887] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:22.848366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eefc3e-98af-4779-a29e-ed9af45b21b0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.929553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44928485-b394-4b9d-893b-44fe33d678a8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:22.955291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eefc3e-98af-4779-a29e-ed9af45b21b0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:22.968049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:22.969086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.969570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.970048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.970971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:22.971833 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:22.973468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:22.983291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 437/888] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:22.989533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:22.993453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:22.994722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:22.995217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:22.995684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:22.996571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:22.998241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:23.011057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:23.012246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:23.013183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:23.020242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 452/889] 10.222.0.99 () {56 vars in 1132 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:23.022967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:23.098634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a409-79e1-4371-9c23-6d194aca9aab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.141358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.142327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.142615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.142891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.144000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] RBAC: Adding query filter params (interface=public, service_id=9fe81b30d8be4a8aa07d8cdc133a53a5, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:23.144309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:23.145703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.146136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea3d70-49fc-450f-a635-349b76e57530 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.152136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 438/890] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:41:22 2022] GET /identity/v3/endpoints?service_id=9fe81b30d8be4a8aa07d8cdc133a53a5&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:23.160806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:23.185375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.186018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.186299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.186571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.187281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:23.187599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:23.189067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.198535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 453/891] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:23.200119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:23.269976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c69a6-b36c-4b88-9866-b0ce30daef22 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.303074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758541d-9368-4b40-9282-b8d04304fea3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.307243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.308456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.308962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.309441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.310322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:23.311965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.318564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 439/892] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:41:23.340982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37af72-8678-410a-a98c-39b1687360c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.342098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37af72-8678-410a-a98c-39b1687360c0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.342574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37af72-8678-410a-a98c-39b1687360c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.343052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37af72-8678-410a-a98c-39b1687360c0 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.344076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37af72-8678-410a-a98c-39b1687360c0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:23.344612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37af72-8678-410a-a98c-39b1687360c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:23.346241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37af72-8678-410a-a98c-39b1687360c0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.353123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 454/893] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:23.359533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:23.467203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03ac8-a464-4015-87a8-2fbe28af970c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.483547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e41f0a-c48a-4033-8150-bf12b9f00652 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.483935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e41f0a-c48a-4033-8150-bf12b9f00652 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.484153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e41f0a-c48a-4033-8150-bf12b9f00652 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.485790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 455/894] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:23.491350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba09d-cbcd-49d3-a462-7b1034f30151 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.491674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba09d-cbcd-49d3-a462-7b1034f30151 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.491940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba09d-cbcd-49d3-a462-7b1034f30151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.508267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.509336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.509614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.509946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.510741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] RBAC: Adding query filter params (interface=public, service_id=e72cd7330f0d4d4782ca6f83eb817aff, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:23.511050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:23.512519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.514682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-de8ba09d-cbcd-49d3-a462-7b1034f30151 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:23.515912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-de8ba09d-cbcd-49d3-a462-7b1034f30151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:23.518598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 440/895] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/endpoints?service_id=e72cd7330f0d4d4782ca6f83eb817aff&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:23.524487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:23.598773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 456/896] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:23.622484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ba09d-cbcd-49d3-a462-7b1034f30151 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:23.647086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153d062-5352-41d1-977d-e89afe132f86 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.691266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.692381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.692863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.693331 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.694626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:23.696580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.705014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 441/897] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:41:23.723393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ba09d-cbcd-49d3-a462-7b1034f30151 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.762460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.763314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.763598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.763891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.776814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:23.785208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:23.786233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:23.787558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 457/898] 10.222.0.99 () {56 vars in 1120 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:23.793303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:23.910066 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe564-5cac-40fc-9580-fda60a3d0890 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:23.942728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:23.943462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:23.943740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:23.944079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:23.944832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:23.945134 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:23.946514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:23.955425 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 442/899] 10.222.0.99 () {56 vars in 1115 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:23.960652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:24.059062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcad16-6815-4d65-98a5-4ca8c5dc3a1e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:24.092600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:24.093461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:24.093799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:24.094087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:24.105497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:24.106951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:24.124529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:24.125504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:24.126546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:24.126546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:24.126546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:24.126546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:24.126546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 458/900] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:24.131703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:24.231559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7edc5-895c-438f-8ea6-cab8b4b09236 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:24.265301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:24.265969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:24.266249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:24.266521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:24.267245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:24.267548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:24.268965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:24.281258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 443/901] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:24.286805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:24.388378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35a3cf-bd8d-4d3d-b200-b62932a50e99 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:24.422209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:24.423046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:24.423332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:24.423606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:24.431430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:24.433513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:24.450391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:24.452724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:24.454956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:24.456233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 459/902] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:41:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:24.461155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:24.575153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360474f-5321-425d-970c-e928a55f47a1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:24.610900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:24.611934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:24.612539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:24.613257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:24.615124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:24.615994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:24.618902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:24.640380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 444/903] 10.222.0.99 () {56 vars in 1149 bytes} [Fri May 13 14:41:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:24.646378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:24.747208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a9113-604f-4b9b-b536-b6a2fd50eca9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:24.780964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1b914-afe5-42ef-87e0-984233eb880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:24.781951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1b914-afe5-42ef-87e0-984233eb880c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:24.782432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1b914-afe5-42ef-87e0-984233eb880c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:24.782898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1b914-afe5-42ef-87e0-984233eb880c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:24.856333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1b914-afe5-42ef-87e0-984233eb880c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:24.858158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1b914-afe5-42ef-87e0-984233eb880c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:24.964191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 460/904] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:24 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:24.966578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:24.995159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f1a55-5c61-436c-8c77-9aea22c1cba2 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:24.995747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f1a55-5c61-436c-8c77-9aea22c1cba2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:24.996213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f1a55-5c61-436c-8c77-9aea22c1cba2 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:24.998471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 461/905] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:25.004355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c133a-6f25-410d-812f-6e2c4dd7946b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.005147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c133a-6f25-410d-812f-6e2c4dd7946b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.005606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c133a-6f25-410d-812f-6e2c4dd7946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.026840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9e9c133a-6f25-410d-812f-6e2c4dd7946b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:25.028770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9e9c133a-6f25-410d-812f-6e2c4dd7946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:25.071233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc5683-c734-40f1-af5a-0e3487bfe80c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:25.105560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:25.106759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.107218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.107668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.119901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 462/906] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:25.120334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:25.121821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:25.137041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c133a-6f25-410d-812f-6e2c4dd7946b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:25.144034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:25.145254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:25.146145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:25.146145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:25.146145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:25.146145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:25.148411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 445/907] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:25.155144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:25.236161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c133a-6f25-410d-812f-6e2c4dd7946b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:25.262876 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15833-61dd-46a9-9ab0-a00207dcecef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:25.269065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:25.269958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.270390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.270802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.271687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:25.273299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:25.292241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 463/908] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:25 2022] POST /identity/v3/services => generated 241 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:41:25.314437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:25.315121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.315461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.315740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.316533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:25.316895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:25.318381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:25.332637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 446/909] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:25.338448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:25.461758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca7755-c4fc-4399-853a-9d6bd6e89e32 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:25.502121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42979f7-ac8e-44b4-b2c7-f87ae735889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:25.502948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42979f7-ac8e-44b4-b2c7-f87ae735889d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.503231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42979f7-ac8e-44b4-b2c7-f87ae735889d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.503505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42979f7-ac8e-44b4-b2c7-f87ae735889d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.512098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42979f7-ac8e-44b4-b2c7-f87ae735889d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:25.513083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42979f7-ac8e-44b4-b2c7-f87ae735889d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e42979f7-ac8e-44b4-b2c7-f87ae735889d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:25.528141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:25.529104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:25.530012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 464/910] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:25.536977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:25.643635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5227-241e-40c1-b5b4-db1a8bfa3d6e None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.643849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5227-241e-40c1-b5b4-db1a8bfa3d6e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.644149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5227-241e-40c1-b5b4-db1a8bfa3d6e None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.647034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 465/911] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:25.651267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff055-14aa-496d-a2db-628ce4f3cf03 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.651582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff055-14aa-496d-a2db-628ce4f3cf03 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.651818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff055-14aa-496d-a2db-628ce4f3cf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.657613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b661-a4fc-438d-8b08-bcd3343bb313 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:25.670075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-49eff055-14aa-496d-a2db-628ce4f3cf03 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:25.671747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-49eff055-14aa-496d-a2db-628ce4f3cf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:25.693166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:25.693831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.694118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.694390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.695178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:25.695488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:25.696975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:25.710114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 447/912] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:25.716673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:25.751754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 466/913] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:25.773907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff055-14aa-496d-a2db-628ce4f3cf03 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:25.821071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e022ac3-e6fe-4ee7-99ae-83e0aa250d82 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:25.857953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:25.858629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.858912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.859186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.860084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] RBAC: Adding query filter params (role.id=dd610af9853e48bbbefddeffa0837860, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=37073a0901464b2393b6b8fa9d71b962) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:25.860395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:25.861880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:25.868768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 448/914] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:25 2022] GET /identity/v3/role_assignments?user.id=37073a0901464b2393b6b8fa9d71b962&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=dd610af9853e48bbbefddeffa0837860 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:25.896444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff055-14aa-496d-a2db-628ce4f3cf03 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:25.934180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46731e54-983b-4e33-a38c-fc90f4cddc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:25.935015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46731e54-983b-4e33-a38c-fc90f4cddc35 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:25.935301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46731e54-983b-4e33-a38c-fc90f4cddc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:25.935577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46731e54-983b-4e33-a38c-fc90f4cddc35 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:25.936290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46731e54-983b-4e33-a38c-fc90f4cddc35 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:25.937710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46731e54-983b-4e33-a38c-fc90f4cddc35 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-46731e54-983b-4e33-a38c-fc90f4cddc35 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:25.950470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:25.951542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:41:25.952448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:25.956000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 467/915] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:25.958451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:26.052485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a219b4-0452-4426-9fe1-6f8210574d27 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.052846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a219b4-0452-4426-9fe1-6f8210574d27 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.053007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a219b4-0452-4426-9fe1-6f8210574d27 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.058700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 468/916] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:26.060508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52eba-ecfe-43df-8ccc-75d5f4e86023 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.060800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52eba-ecfe-43df-8ccc-75d5f4e86023 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.061078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52eba-ecfe-43df-8ccc-75d5f4e86023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.064439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078f40-06e4-43fb-917b-103a65467f72 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:26.081513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5ae52eba-ecfe-43df-8ccc-75d5f4e86023 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:26.082979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5ae52eba-ecfe-43df-8ccc-75d5f4e86023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:26.110666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:26.111998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.112680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.113483 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.114665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:26.115320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:26.117586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:26.124805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 449/917] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:26.130844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:26.159971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 469/918] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:26.178148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52eba-ecfe-43df-8ccc-75d5f4e86023 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:26.250211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755db4d-008a-4e1a-ba99-475f8533d77b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:26.291681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52eba-ecfe-43df-8ccc-75d5f4e86023 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:26.293962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:26.295682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.296210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.296756 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.297710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:26.298212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:26.300252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:26.311291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 450/919] 10.222.0.99 () {56 vars in 1114 bytes} [Fri May 13 14:41:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:26.313514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:26.335887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:26.336781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.337060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.337329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.338035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:26.339395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:26.355762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:26.356766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:26.357617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 470/920] 10.222.0.99 () {56 vars in 1132 bytes} [Fri May 13 14:41:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:26.365302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:26.443153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce461d-4655-41d5-8b5a-f5af2d05dd8c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:26.474912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b50dd-4b33-46df-a9a4-939a9a0af4c6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:26.482183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:26.482891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.483173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.483445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.484220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:26.485604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:26.520041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 451/921] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:26.532679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:26.533374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.533641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.533908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.534681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:26.534997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:26.536488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:26.542576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 471/922] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:26.548549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:26.660566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443a529-2e8b-48ce-8deb-09c52fbef27b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:26.697185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8e447-daf4-41ba-bcd8-02c0298e76ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:26.697780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8e447-daf4-41ba-bcd8-02c0298e76ee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.698045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8e447-daf4-41ba-bcd8-02c0298e76ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.698313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8e447-daf4-41ba-bcd8-02c0298e76ee None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.699022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8e447-daf4-41ba-bcd8-02c0298e76ee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:26.699323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8e447-daf4-41ba-bcd8-02c0298e76ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:26.700810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8e447-daf4-41ba-bcd8-02c0298e76ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:26.706735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 452/923] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:26.713185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:26.814951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34778c-2ef5-4b12-a465-2f4c438ec48c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:26.848942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e39398-d9d7-42b5-a3f6-852924006581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:26.849648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e39398-d9d7-42b5-a3f6-852924006581 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:26.849931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e39398-d9d7-42b5-a3f6-852924006581 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:26.850202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e39398-d9d7-42b5-a3f6-852924006581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:26.850938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e39398-d9d7-42b5-a3f6-852924006581 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:26.852341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e39398-d9d7-42b5-a3f6-852924006581 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:26.872724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 472/924] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:27.717040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce6f8-16d7-4b87-b26a-a1dfcee6bc17 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:27.717564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce6f8-16d7-4b87-b26a-a1dfcee6bc17 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:27.717564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce6f8-16d7-4b87-b26a-a1dfcee6bc17 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:27.719178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 453/925] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:27.725170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dfc43-4d86-48fe-8e03-afe402e5aee9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:27.725602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dfc43-4d86-48fe-8e03-afe402e5aee9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:27.725771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dfc43-4d86-48fe-8e03-afe402e5aee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:27.745424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b92dfc43-4d86-48fe-8e03-afe402e5aee9 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:27.746649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b92dfc43-4d86-48fe-8e03-afe402e5aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:27.824807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 473/926] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:27.847823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ce6f8-16d7-4b87-b26a-a1dfcee6bc17 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:27.960208 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ce6f8-16d7-4b87-b26a-a1dfcee6bc17 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:27.996976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537df1-ee19-4cb8-a77a-0b7af5c0bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:27.997797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537df1-ee19-4cb8-a77a-0b7af5c0bcfb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:27.998079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537df1-ee19-4cb8-a77a-0b7af5c0bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:27.998354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537df1-ee19-4cb8-a77a-0b7af5c0bcfb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:27.999013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64537df1-ee19-4cb8-a77a-0b7af5c0bcfb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.000433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64537df1-ee19-4cb8-a77a-0b7af5c0bcfb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-64537df1-ee19-4cb8-a77a-0b7af5c0bcfb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:28.013321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:28.014352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:28.016259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 454/927] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:28.020908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dfc43-4d86-48fe-8e03-afe402e5aee9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.120909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dfc43-4d86-48fe-8e03-afe402e5aee9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.136505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d817d-8562-46f2-a8e1-bc4b980f1be8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.136825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d817d-8562-46f2-a8e1-bc4b980f1be8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.137055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d817d-8562-46f2-a8e1-bc4b980f1be8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.138634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 455/928] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:28.143680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f530333-96d2-41aa-a677-5770731ca994 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.144052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f530333-96d2-41aa-a677-5770731ca994 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.144332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f530333-96d2-41aa-a677-5770731ca994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.155087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.156206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.156485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.156755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.157741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:28.158043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.159402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.160894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4f530333-96d2-41aa-a677-5770731ca994 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:28.162078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4f530333-96d2-41aa-a677-5770731ca994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:28.165363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 474/929] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:28.172805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.246585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 456/930] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:28.269031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f530333-96d2-41aa-a677-5770731ca994 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.289125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d143c-c0a4-4eca-9e93-c4d922a9766d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.323134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.323508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.323781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.324091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.324807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:28.325112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.326551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.336525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 475/931] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:28.337572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.376341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f530333-96d2-41aa-a677-5770731ca994 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.410261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.411361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.411790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.412232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.422957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:28.431436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:28.432421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:28.433275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:28.439900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe325-3505-4fbd-aa1a-f702b369dd27 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.440450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 457/932] 10.222.0.99 () {56 vars in 1120 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:28.442272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.480215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.480946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.481234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.481540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.482489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] RBAC: Adding query filter params (interface=public, service_id=36c357d9ac23455db5541bbefbc0f90b, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:28.482801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.484265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.494671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 476/933] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/endpoints?service_id=36c357d9ac23455db5541bbefbc0f90b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:28.495707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.562683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bde21-2ccc-4bad-9925-6fc9bd9dcb47 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.597471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.598558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.599042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.599525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.600520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:28.601044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.602626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.602981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0883-3e0b-495a-9d76-a766000b8795 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.616681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 458/934] 10.222.0.99 () {56 vars in 1115 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:28.617908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.638252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.638851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.639134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.639410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.640177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.641715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.648031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 477/935] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:41:28.727355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f026-2ea7-496a-9970-7ff98924fc85 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.767631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7241f-55f3-4c39-922f-5b8ffd19c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.768922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7241f-55f3-4c39-922f-5b8ffd19c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.769409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7241f-55f3-4c39-922f-5b8ffd19c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.769888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7241f-55f3-4c39-922f-5b8ffd19c7b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.783531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7241f-55f3-4c39-922f-5b8ffd19c7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.785507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7241f-55f3-4c39-922f-5b8ffd19c7b0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9cb7241f-55f3-4c39-922f-5b8ffd19c7b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:28.804963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:28.805932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:28.807069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:28.807069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:28.807069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:28.807069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:28.809531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 459/936] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:28.815582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:28.927818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d4801-bbf9-441f-8480-1e31c98efd32 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:28.956187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112407e-0022-4100-9b7e-dce0923d2b02 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.956514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112407e-0022-4100-9b7e-dce0923d2b02 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.956737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112407e-0022-4100-9b7e-dce0923d2b02 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.958220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 460/937] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:28.963117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f361d-6ac8-4817-953b-5492a7243387 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.963587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f361d-6ac8-4817-953b-5492a7243387 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.963884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f361d-6ac8-4817-953b-5492a7243387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.965975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:28.966916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:28.967478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:28.967985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:28.969100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:28.969594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:28.972502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:28.983430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-812f361d-6ac8-4817-953b-5492a7243387 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:28.984810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-812f361d-6ac8-4817-953b-5492a7243387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:28.987635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 478/938] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:28.995685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.075561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 461/939] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:29.099159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f361d-6ac8-4817-953b-5492a7243387 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.110961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e657-9c6a-4fe3-9417-ce6cdaeb3a8a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.145666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d6e65-bdb7-4d39-bbba-84e150039bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.146915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6e65-bdb7-4d39-bbba-84e150039bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.147387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6e65-bdb7-4d39-bbba-84e150039bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.147846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6e65-bdb7-4d39-bbba-84e150039bc1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.156100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d6e65-bdb7-4d39-bbba-84e150039bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.157777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d6e65-bdb7-4d39-bbba-84e150039bc1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6d5d6e65-bdb7-4d39-bbba-84e150039bc1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:29.173118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:29.176121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 479/940] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:41:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a1a0-ce88-419a-a090-08e4083dbc75 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.179306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a1a0-ce88-419a-a090-08e4083dbc75 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.180828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a1a0-ce88-419a-a090-08e4083dbc75 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.180828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 480/941] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:29.180828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a1a0-ce88-419a-a090-08e4083dbc75 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.213606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f361d-6ac8-4817-953b-5492a7243387 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.246516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.247423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.247853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.248278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.249142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.250719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.252268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING keystone.server.flask.common [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 14:41:29.268839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.sql.core [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 14:41:29.268839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 14:41:29.268839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [parameters: {'id': '2e7a7a69278741258b87289da44b86f3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 14:41:29.268839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80254) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 14:41:29.280779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a1a0-ce88-419a-a090-08e4083dbc75 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6afb9a17-441d-4ed4-a707-14bc36d0a1d3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2e7a7a69278741258b87289da44b86f3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2e7a7a69278741258b87289da44b86f3. May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:41:29.287372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 13 14:41:29.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return project_ref.to_dict() May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application yield resource May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.rollback() May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.force_reraise() May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise self.value May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application session.commit() May 13 14:41:29.289626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._prepare_impl() May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.flush() May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._flush(objects) May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application compat.raise_( May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application flush_context.execute() May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 14:41:29.290741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rec.execute(self) May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 14:41:29.291830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:41:29.293589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [parameters: {'id': '2e7a7a69278741258b87289da44b86f3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.295740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:29.297632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.Conflict( May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2e7a7a69278741258b87289da44b86f3. May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 462/942] 10.222.0.99 () {60 vars in 1140 bytes} [Fri May 13 14:41:29 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e63a4-2890-481b-bce3-b1eb8f8509db None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.300085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e63a4-2890-481b-bce3-b1eb8f8509db None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.301697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e63a4-2890-481b-bce3-b1eb8f8509db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.317303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fb4e63a4-2890-481b-bce3-b1eb8f8509db None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:29.318727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fb4e63a4-2890-481b-bce3-b1eb8f8509db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:29.321838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.322528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.322801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.323137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.324003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:29.324311 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.325729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.344134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 481/943] 10.222.0.99 () {56 vars in 1149 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:29.345381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.387432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 463/944] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:29.388328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e63a4-2890-481b-bce3-b1eb8f8509db None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.446759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc178006-e8ea-438f-9afe-3be845530b25 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.483190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.484043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.484332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.484611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.491409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.492894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.498548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e63a4-2890-481b-bce3-b1eb8f8509db None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:29.506965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:29.508053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:29.509333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 482/945] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:29.510262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.544119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.544921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.545197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.545465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.559920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.561931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:29.579528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:29.580644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:29.581738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:29.581738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:29.581738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:29.581738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:29.581738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 464/946] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:29.582196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.615909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c58be5-e10d-482e-af92-46aa7c60f088 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.648230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.649296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.649787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.650711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.651377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.652791 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:29.664443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:29.665482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:29.666695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 483/947] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:29.667487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.683321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5786f7-6d03-42bd-a141-311a9e2dea6f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.718056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.718808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.719166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.719454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.720297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:29.720611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.722416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.751903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 465/948] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:29.751903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.780768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8491b-0fd0-45fb-9885-d8cc6c872f8b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.816742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.817490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.817777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.818054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.818853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:29.819165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.820884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.838485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 484/949] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:29.844177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.868671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093de5d-d8e5-4d88-a19c-737a6e8a0e5a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.904324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.905402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.905898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.906381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.907294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:29.907799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:29.909658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:29.920275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 466/950] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:29.922309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:29.954744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78cbc6-6430-41e8-9f0b-fcd39f7858ff None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:29.990812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:29.991548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:29.991897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:29.992135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:29.999465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:30.000968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:30.016541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:30.017486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:30.018390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:30.020651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 485/951] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:30.026897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:30.032591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77081e-96bf-4317-a8eb-b67b61fb13a0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:30.077647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:30.078978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:30.079443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:30.079919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:30.080822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:30.081747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:30.083819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:30.091151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 467/952] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:30.133986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4617bc-947a-4b5f-8374-d13c3a73f2a6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:30.172135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51e75e-fc70-4993-a6db-b26898cfd397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:30.173169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e75e-fc70-4993-a6db-b26898cfd397 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:30.173655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e75e-fc70-4993-a6db-b26898cfd397 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:30.174108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e75e-fc70-4993-a6db-b26898cfd397 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:30.175099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51e75e-fc70-4993-a6db-b26898cfd397 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:30.175667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51e75e-fc70-4993-a6db-b26898cfd397 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:30.177413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51e75e-fc70-4993-a6db-b26898cfd397 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:30.194274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 486/953] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:30.201010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:30.314431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537534-8c1c-4a11-8747-0816ccf21739 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:30.351319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522c65-0463-4dcc-82a4-6f62428affd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:30.352243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522c65-0463-4dcc-82a4-6f62428affd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:30.352522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522c65-0463-4dcc-82a4-6f62428affd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:30.352879 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522c65-0463-4dcc-82a4-6f62428affd2 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/37073a0901464b2393b6b8fa9d71b962/roles/dd610af9853e48bbbefddeffa0837860` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:30.355171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522c65-0463-4dcc-82a4-6f62428affd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=37073a0901464b2393b6b8fa9d71b962, role_id=dd610af9853e48bbbefddeffa0837860)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:30.356639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522c65-0463-4dcc-82a4-6f62428affd2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:30.372236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 468/954] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:41:30 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/37073a0901464b2393b6b8fa9d71b962/roles/dd610af9853e48bbbefddeffa0837860 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:41:30.995895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d968-d13e-4625-ae2a-db3dab9ad5b8 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:30.996443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d968-d13e-4625-ae2a-db3dab9ad5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:30.996443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d968-d13e-4625-ae2a-db3dab9ad5b8 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:30.998159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 487/955] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:31.004343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4761-a839-4508-85a1-96b463b6b7ad None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:31.004861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4761-a839-4508-85a1-96b463b6b7ad None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:31.004935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4761-a839-4508-85a1-96b463b6b7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:31.021924 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2aee4761-a839-4508-85a1-96b463b6b7ad None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:31.023104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2aee4761-a839-4508-85a1-96b463b6b7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:31.088750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 469/956] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:31.111921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369d968-d13e-4625-ae2a-db3dab9ad5b8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:31.211350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369d968-d13e-4625-ae2a-db3dab9ad5b8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:31.246311 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:31.247042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:31.247321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:31.247592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:31.248279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:31.249647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:31.261643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:31.262622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:31.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 488/957] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:31.269300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee4761-a839-4508-85a1-96b463b6b7ad None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:31.367912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee4761-a839-4508-85a1-96b463b6b7ad None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:31.401118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:31.401793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:31.402075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:31.402353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:31.403061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:31.403365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:31.404777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:31.409859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 470/958] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:31.415716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:31.514441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e469e-771e-49ac-a337-c1a8a11e5965 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:31.549747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901535c-9ba5-497e-b1f5-f30c33c8ec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:31.550420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901535c-9ba5-497e-b1f5-f30c33c8ec3f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:31.550701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901535c-9ba5-497e-b1f5-f30c33c8ec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:31.550975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901535c-9ba5-497e-b1f5-f30c33c8ec3f None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:31.551687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901535c-9ba5-497e-b1f5-f30c33c8ec3f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:31.552024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901535c-9ba5-497e-b1f5-f30c33c8ec3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:31.553403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901535c-9ba5-497e-b1f5-f30c33c8ec3f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:31.558766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 489/959] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:31.564468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:31.686472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596217e-cda4-4254-9ac2-35e6c3d305e0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:31.735154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8400-bed9-4ec7-b31f-11eef766aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:31.737176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8400-bed9-4ec7-b31f-11eef766aa3d None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:31.737176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8400-bed9-4ec7-b31f-11eef766aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:31.737176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8400-bed9-4ec7-b31f-11eef766aa3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:31.737738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8400-bed9-4ec7-b31f-11eef766aa3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:31.738806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8400-bed9-4ec7-b31f-11eef766aa3d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:31.776975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 471/960] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:32.148906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cceeaa-c723-4fc3-aa73-b913a5dda2ae None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.149535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cceeaa-c723-4fc3-aa73-b913a5dda2ae None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.149535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cceeaa-c723-4fc3-aa73-b913a5dda2ae None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.151232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 490/961] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:32.156779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304c609-93e0-4232-bb47-7bd599eef482 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.157333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304c609-93e0-4232-bb47-7bd599eef482 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.157333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304c609-93e0-4232-bb47-7bd599eef482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.174934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a304c609-93e0-4232-bb47-7bd599eef482 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:32.176168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a304c609-93e0-4232-bb47-7bd599eef482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:32.247431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 472/962] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:32.272012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cceeaa-c723-4fc3-aa73-b913a5dda2ae None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:32.375265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cceeaa-c723-4fc3-aa73-b913a5dda2ae None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:32.407985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:32.408575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.408854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.409129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.409842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:32.411266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:32.412609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING keystone.server.flask.common [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 14:41:32.425678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.sql.core [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 14:41:32.425678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 14:41:32.425678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [parameters: {'user_id': 'fabc695375ae4ddb87ffba6d586bb7a1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 14:41:32.425678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80255) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-397efd18-3997-4db7-bb3f-effc6e068329 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application conn.query(q) May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result.read() May 13 14:41:32.433763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:41:32.435761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application next(self.gen) May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application yield resource May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application next(self.gen) May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.session.rollback() May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.force_reraise() May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise self.value May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application session.commit() May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 14:41:32.438118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._prepare_impl() May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.session.flush() May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._flush(objects) May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application compat.raise_( May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application flush_context.execute() May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rec.execute(self) May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 14:41:32.440303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result = connection._execute_20( May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:41:32.442391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application conn.query(q) May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result.read() May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:41:32.452566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fabc695375ae4ddb87ffba6d586bb7a1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:32.454574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 13 14:41:32.456489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 13 14:41:32.458642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 13 14:41:32.458642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 13 14:41:32.458642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 14:41:32.458642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 14:41:32.458642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 14:41:32.458642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:32.458642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 491/963] 10.222.0.99 () {60 vars in 1131 bytes} [Fri May 13 14:41:32 2022] POST /identity/v3/users => generated 160 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:32.459534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304c609-93e0-4232-bb47-7bd599eef482 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:32.459686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d4ce-cfbe-46ad-a0f8-f539acdd997a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.459686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d4ce-cfbe-46ad-a0f8-f539acdd997a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.459686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d4ce-cfbe-46ad-a0f8-f539acdd997a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.462920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 492/964] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:32.468890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22afb87-723f-48ec-ab95-863d1b670ff0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.469169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22afb87-723f-48ec-ab95-863d1b670ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.469441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22afb87-723f-48ec-ab95-863d1b670ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.491270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c22afb87-723f-48ec-ab95-863d1b670ff0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:32.492869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c22afb87-723f-48ec-ab95-863d1b670ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:32.570933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 493/965] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:32.579798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304c609-93e0-4232-bb47-7bd599eef482 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:32.592385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22afb87-723f-48ec-ab95-863d1b670ff0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:32.625302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:32.626767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.631935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.632430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.643206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:32.645045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:32.666247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:32.667336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:41:32.668315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:32.671909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 473/966] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:32.678491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:32.698836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22afb87-723f-48ec-ab95-863d1b670ff0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:32.735395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ca96-967e-4388-ae2f-d03b6ca8808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:32.736375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ca96-967e-4388-ae2f-d03b6ca8808d None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.736655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ca96-967e-4388-ae2f-d03b6ca8808d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.736925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ca96-967e-4388-ae2f-d03b6ca8808d None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.737657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8ca96-967e-4388-ae2f-d03b6ca8808d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:32.739148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8ca96-967e-4388-ae2f-d03b6ca8808d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:32.752598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 494/967] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:32 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:41:32.754222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3681f7-bf28-493f-afe4-4b5935bbf6e9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.754560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3681f7-bf28-493f-afe4-4b5935bbf6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.754898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3681f7-bf28-493f-afe4-4b5935bbf6e9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.756443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 495/968] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:32.762226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7728-bd70-4d15-b41f-bd2385f34b5e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.762519 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7728-bd70-4d15-b41f-bd2385f34b5e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.762801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7728-bd70-4d15-b41f-bd2385f34b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.784195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-fcec7728-bd70-4d15-b41f-bd2385f34b5e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:32.785820 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fcec7728-bd70-4d15-b41f-bd2385f34b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:32.806493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b11b3-3df1-47fb-a104-2d5fd50dbdfa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:32.860847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:32.861636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:32.861979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:32.862317 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:32.863043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 496/969] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:32.864466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:32.864979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:32.866630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:32.887083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec7728-bd70-4d15-b41f-bd2385f34b5e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:32.928477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 474/970] 10.222.0.99 () {56 vars in 1101 bytes} [Fri May 13 14:41:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:33.001990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec7728-bd70-4d15-b41f-bd2385f34b5e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:33.039636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:33.040556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:33.040839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:33.041112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:33.052817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:33.061362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:33.062502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:33.063394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 497/971] 10.222.0.99 () {56 vars in 1120 bytes} [Fri May 13 14:41:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:33.070688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:33.172481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca75b73-8366-452b-8c4b-5063ae5ba5be None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:33.207793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:33.208877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:33.209426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:33.209954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:33.210891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:33.211407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:33.213038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:33.222578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 475/972] 10.222.0.99 () {56 vars in 1115 bytes} [Fri May 13 14:41:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:33.228490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:33.324352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec7af9-d7fa-4eaf-b60e-a4e0200463f4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:33.356690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:33.357490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:33.357769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:33.358039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:33.368072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:33.369699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:33.385826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:33.386880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:33.388553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:33.388553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:33.388553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:33.388553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:33.388994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 498/973] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:33.392895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:33.492655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f281e-1103-4c3c-86dc-af9db04b563c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:33.529563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:33.530228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:33.530506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:33.530776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:33.531483 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:33.531785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:33.533182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:33.545051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 476/974] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:33.550391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:33.650762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83898f-917a-4f94-bae5-e9d2f1edfcd8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:33.683718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:33.684562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:33.684839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:33.685110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:33.692710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:33.694139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:33.708450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:33.709505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:41:33.710459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:33.711994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 499/975] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:41:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:33.715533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:33.812895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000788-2b6e-481f-8f13-f888541504ec None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:33.847296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf0765-a89d-4f20-b79c-f1b76d4f5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:33.847987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0765-a89d-4f20-b79c-f1b76d4f5016 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:33.848264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0765-a89d-4f20-b79c-f1b76d4f5016 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:33.848504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0765-a89d-4f20-b79c-f1b76d4f5016 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:33.849347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf0765-a89d-4f20-b79c-f1b76d4f5016 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:33.849650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf0765-a89d-4f20-b79c-f1b76d4f5016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:33.851088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf0765-a89d-4f20-b79c-f1b76d4f5016 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:33.868393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 477/976] 10.222.0.99 () {56 vars in 1149 bytes} [Fri May 13 14:41:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:33.873801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:33.978439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34786-24ab-4d74-b1ce-f27dae7bb555 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.012422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.013083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.013361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.013632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.080196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.081558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.108210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351826-97b4-4ae4-8a81-9b168a836ed8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.108486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351826-97b4-4ae4-8a81-9b168a836ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.108776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351826-97b4-4ae4-8a81-9b168a836ed8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.110286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 478/977] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:34.114984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2832ae-7757-4117-9947-15d375bbea94 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.115272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2832ae-7757-4117-9947-15d375bbea94 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.115548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2832ae-7757-4117-9947-15d375bbea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.131688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0d2832ae-7757-4117-9947-15d375bbea94 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:34.132904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d2832ae-7757-4117-9947-15d375bbea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:34.180485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 500/978] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:33 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:34.182317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.197656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 479/979] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:34.219496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2832ae-7757-4117-9947-15d375bbea94 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.277956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e868635-0b4c-4a5b-b646-a1171b40978d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.310645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.311799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.312255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.312528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.314228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2832ae-7757-4117-9947-15d375bbea94 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.322240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.323686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:34.341935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:34.342860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:34.348752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:34.348752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:34.348752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:34.348752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:34.348752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 501/980] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:34.349044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.349044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.349196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.349379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.350036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.350821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.351422 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:34.364803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:34.366197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:34.367062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 480/981] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:34.372350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.454028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459cc49-4c41-4b35-8e9c-d382444624d2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.468532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996806ca-5bec-4ccd-aef9-71f9a3316957 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.488425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.489098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.489380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.489660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.490385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:34.490693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.492082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.507767 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 502/982] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:34.511146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.514160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.514852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.515132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.515409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.516156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:34.516474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.517859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.527577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 481/983] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:34.528792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.610688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffa60d-2db2-44f9-b733-0c9dd72d6cb2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.628347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775972a5-1623-4f5c-acca-828f337df2ff None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.647206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.648035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.648318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.648997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.657927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.660000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.662315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.662977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.663253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.663520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.664247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:34.664549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.665978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.671100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 482/984] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:34.676665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:34.680818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:34.681910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:34.682913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:34.684176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 503/985] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:34.686955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.782194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36273-680e-437b-a3f0-cf66aae9f4f5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.783302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2350f9-0176-4df3-acb4-ed086a254638 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.816315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.817428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.817852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.818221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.818444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.818945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.819226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.819495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.819824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:34.820291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.820416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] RBAC: Adding query filter params (interface=admin, service_id=36c357d9ac23455db5541bbefbc0f90b, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:34.820612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.822062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.822327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.827720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 483/986] 10.222.0.99 () {56 vars in 1249 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/endpoints?service_id=36c357d9ac23455db5541bbefbc0f90b&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:34.833148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.835073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 504/987] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:34.841221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:34.936981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8a87-09f3-4960-8d8e-3c5e90e3fe56 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.939401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc70016-be85-477c-a153-3236c6ccdc90 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:34.971574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23067a26-e2d5-4557-9961-7483437514ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.972287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067a26-e2d5-4557-9961-7483437514ab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.972591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067a26-e2d5-4557-9961-7483437514ab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.972829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067a26-e2d5-4557-9961-7483437514ab None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.973310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d241294-7bee-42b5-b173-e97935236c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:34.973518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23067a26-e2d5-4557-9961-7483437514ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.973973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241294-7bee-42b5-b173-e97935236c77 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:34.974254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241294-7bee-42b5-b173-e97935236c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:34.974525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241294-7bee-42b5-b173-e97935236c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:34.974858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23067a26-e2d5-4557-9961-7483437514ab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.975357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d241294-7bee-42b5-b173-e97935236c77 None admin] RBAC: Adding query filter params (role.id=dd610af9853e48bbbefddeffa0837860, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=37073a0901464b2393b6b8fa9d71b962) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:34.975768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d241294-7bee-42b5-b173-e97935236c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:34.977126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d241294-7bee-42b5-b173-e97935236c77 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:34.981313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 484/988] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:41:34.983895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 505/989] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:34 2022] GET /identity/v3/role_assignments?user.id=37073a0901464b2393b6b8fa9d71b962&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=dd610af9853e48bbbefddeffa0837860 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:35.055446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b765f-a544-4c64-a5bb-05d4134a6f7f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:35.055946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b765f-a544-4c64-a5bb-05d4134a6f7f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:35.056392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b765f-a544-4c64-a5bb-05d4134a6f7f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:35.058082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 485/990] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:35.064345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056af1-28e2-43e3-8b8e-37047279a58f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:35.064604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056af1-28e2-43e3-8b8e-37047279a58f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:35.065001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056af1-28e2-43e3-8b8e-37047279a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:35.083905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e5056af1-28e2-43e3-8b8e-37047279a58f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:35.085282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e5056af1-28e2-43e3-8b8e-37047279a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:35.168285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 506/991] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:35.184915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b765f-a544-4c64-a5bb-05d4134a6f7f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:35.284701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b765f-a544-4c64-a5bb-05d4134a6f7f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:35.318361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:35.319159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:35.319438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:35.319710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:35.320392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:35.321834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:35.333560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:35.334588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:35.335431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 486/992] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:35.343183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056af1-28e2-43e3-8b8e-37047279a58f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:35.441248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056af1-28e2-43e3-8b8e-37047279a58f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:35.474961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:35.475641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:35.475933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:35.476201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:35.476917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:35.477209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:35.478661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:35.483891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 507/993] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:35.489499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:35.590666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd02cd-6a2d-49c2-b3cb-5cd70ea4f7ae None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:35.624616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:35.625286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:35.625566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:35.625837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:35.626544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:35.626849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:35.628261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:35.633180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 487/994] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:35.639528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:35.736512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e07a5-ef4d-44aa-95cd-697ceeed47b3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:35.770706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340244d4-37be-4384-a7a4-86db012f3dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:35.771362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340244d4-37be-4384-a7a4-86db012f3dea None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:35.771646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340244d4-37be-4384-a7a4-86db012f3dea None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:35.771936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340244d4-37be-4384-a7a4-86db012f3dea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:35.772726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340244d4-37be-4384-a7a4-86db012f3dea None admin] RBAC: Adding query filter params (interface=public, service_id=4ebed3d72e1c44ee9b0074255b8dad69, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:35.773031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340244d4-37be-4384-a7a4-86db012f3dea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:35.774429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340244d4-37be-4384-a7a4-86db012f3dea None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:35.779706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 508/995] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:41:35 2022] GET /identity/v3/endpoints?service_id=4ebed3d72e1c44ee9b0074255b8dad69&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:35.785264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:35.884377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ee09-bc54-4956-bfac-752f07f670d1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:35.917354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c9940-0dcf-42f8-9111-3eae2d097c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:35.918011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c9940-0dcf-42f8-9111-3eae2d097c0e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:35.918291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c9940-0dcf-42f8-9111-3eae2d097c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:35.918564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c9940-0dcf-42f8-9111-3eae2d097c0e None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:35.919222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c9940-0dcf-42f8-9111-3eae2d097c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:35.920604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c9940-0dcf-42f8-9111-3eae2d097c0e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:35.926904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 488/996] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:35 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:41:37.225022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415fc9-4906-4820-8ec7-f1ad282f5f96 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.225594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415fc9-4906-4820-8ec7-f1ad282f5f96 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.225594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe415fc9-4906-4820-8ec7-f1ad282f5f96 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.226898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 509/997] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:37.232759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df864b58-8bd2-4427-ad69-52806b261955 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.233190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df864b58-8bd2-4427-ad69-52806b261955 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.233328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df864b58-8bd2-4427-ad69-52806b261955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.250743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-df864b58-8bd2-4427-ad69-52806b261955 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:37.251952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df864b58-8bd2-4427-ad69-52806b261955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:37.308262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ca8cb-ea70-4329-b3c3-e1358a26c198 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.308647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ca8cb-ea70-4329-b3c3-e1358a26c198 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.308931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ca8cb-ea70-4329-b3c3-e1358a26c198 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.310300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 510/998] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:37.315233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285513-1ff7-43f3-9e84-9ffbd9f497a8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.315521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285513-1ff7-43f3-9e84-9ffbd9f497a8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.315797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285513-1ff7-43f3-9e84-9ffbd9f497a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.319900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 489/999] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:37.332060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a7285513-1ff7-43f3-9e84-9ffbd9f497a8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:37.333219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a7285513-1ff7-43f3-9e84-9ffbd9f497a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:37.342089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df864b58-8bd2-4427-ad69-52806b261955 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:37.398583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 511/1000] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:37.420776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285513-1ff7-43f3-9e84-9ffbd9f497a8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:37.451636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df864b58-8bd2-4427-ad69-52806b261955 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:37.488423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:37.489162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.489443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.489715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.490372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:37.491760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:37.503623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:37.504665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:41:37.505498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:37.511085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 490/1001] 10.222.0.99 () {56 vars in 1126 bytes} [Fri May 13 14:41:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:37.511771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:37.524580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285513-1ff7-43f3-9e84-9ffbd9f497a8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:37.561186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:37.562412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.562762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.563039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] PATH_INFO: `/v3/services/image` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.563691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:37.565081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:37.576450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:37.577475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:37.578348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 512/1002] 10.222.0.99 () {56 vars in 1105 bytes} [Fri May 13 14:41:37 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:37.583689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:37.614311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef25ba-ab18-49be-add7-46d3d9da6626 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:37.648397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:37.649060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.649372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.649635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.650350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:37.650653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:37.652065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:37.657763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 491/1003] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:37.663252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:37.683858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479fd25-c6ed-4658-b597-3bac68a0df34 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:37.717272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:37.717925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.718220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.718498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.719205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:37.719510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:37.721243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:37.730823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 513/1004] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:37.731732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:37.762295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3e4e-ffe6-4ed9-a010-50673fa2514a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:37.801093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:37.801760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.802041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.802315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.803004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:37.803325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:37.804743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:37.809773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 492/1005] 10.222.0.99 () {56 vars in 1122 bytes} [Fri May 13 14:41:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:37.815176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:37.833670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253ff5-aa46-4fa7-99fa-bf8dd29560e7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:37.871971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346ba63-0b68-4ff6-9138-8b9b9caa6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:37.872644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ba63-0b68-4ff6-9138-8b9b9caa6b49 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.872928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ba63-0b68-4ff6-9138-8b9b9caa6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.873215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ba63-0b68-4ff6-9138-8b9b9caa6b49 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.873920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346ba63-0b68-4ff6-9138-8b9b9caa6b49 None admin] RBAC: Adding query filter params (type=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:37.874229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346ba63-0b68-4ff6-9138-8b9b9caa6b49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:37.875597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346ba63-0b68-4ff6-9138-8b9b9caa6b49 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:37.888016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 514/1006] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:37.921235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dadd9f-3805-494a-8f90-0959c0c1a47c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:37.964128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3bfd5-059e-4837-ba7c-929de3e0383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:37.964819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3bfd5-059e-4837-ba7c-929de3e0383b None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:37.965097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3bfd5-059e-4837-ba7c-929de3e0383b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:37.965367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3bfd5-059e-4837-ba7c-929de3e0383b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:37.966125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3bfd5-059e-4837-ba7c-929de3e0383b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:37.967543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3bfd5-059e-4837-ba7c-929de3e0383b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:37.986331 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 493/1007] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:41:38.127298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5f20-61fb-4da5-957c-661da029b13e None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:38.127502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5f20-61fb-4da5-957c-661da029b13e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:38.127784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5f20-61fb-4da5-957c-661da029b13e None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:38.129290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 515/1008] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:38.135467 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42c6-7f9a-4ed4-b42f-25cc0250e0e2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:38.135787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42c6-7f9a-4ed4-b42f-25cc0250e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:38.136038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42c6-7f9a-4ed4-b42f-25cc0250e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:38.154046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-470b42c6-7f9a-4ed4-b42f-25cc0250e0e2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:38.155240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-470b42c6-7f9a-4ed4-b42f-25cc0250e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:38.228909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 494/1009] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:38.251216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa5f20-61fb-4da5-957c-661da029b13e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:38.350790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa5f20-61fb-4da5-957c-661da029b13e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:38.383291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:38.384238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:38.384517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:38.384786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:38.385436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:38.386799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:38.398493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:38.401473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:38.402321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 516/1010] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:38.405995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b42c6-7f9a-4ed4-b42f-25cc0250e0e2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:38.515919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b42c6-7f9a-4ed4-b42f-25cc0250e0e2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:38.550242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:38.550914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:38.551193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:38.551465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:38.552213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:38.552519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:38.553904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:38.560045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 495/1011] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:38.564727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:38.663663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194702a-08a0-44d9-ab46-518a98e0bfb6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:38.697456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a180-1eeb-41a4-9f8f-8e40e0dd2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:38.698130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a180-1eeb-41a4-9f8f-8e40e0dd2620 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:38.698412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a180-1eeb-41a4-9f8f-8e40e0dd2620 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:38.698685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a180-1eeb-41a4-9f8f-8e40e0dd2620 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:38.699390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a180-1eeb-41a4-9f8f-8e40e0dd2620 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:38.699695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a180-1eeb-41a4-9f8f-8e40e0dd2620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:38.701102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a180-1eeb-41a4-9f8f-8e40e0dd2620 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:38.706224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 517/1012] 10.222.0.99 () {56 vars in 1112 bytes} [Fri May 13 14:41:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:38.711851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:38.820040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327da644-8e8b-49fd-8317-27647f989d86 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:38.855275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d363-b129-4637-bb82-b8223a88321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:38.856421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d363-b129-4637-bb82-b8223a88321c None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:38.856911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d363-b129-4637-bb82-b8223a88321c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:38.857391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d363-b129-4637-bb82-b8223a88321c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:38.858326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d363-b129-4637-bb82-b8223a88321c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:38.859937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d363-b129-4637-bb82-b8223a88321c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:38.887911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 496/1013] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:40.097656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca4ce-d37a-4224-9a63-a1d28386f8d7 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:40.098230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca4ce-d37a-4224-9a63-a1d28386f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:40.098230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca4ce-d37a-4224-9a63-a1d28386f8d7 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:40.099683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 518/1014] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:40.104875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96eade-a8a9-400d-874c-db6d465ac7ab None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:40.105281 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96eade-a8a9-400d-874c-db6d465ac7ab None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:40.105468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96eade-a8a9-400d-874c-db6d465ac7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:40.122580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8e96eade-a8a9-400d-874c-db6d465ac7ab None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:40.123763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8e96eade-a8a9-400d-874c-db6d465ac7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:40.193769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 497/1015] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:40 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:40.210162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504f07-1613-46d6-8510-581cb33826b6 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:40.210445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504f07-1613-46d6-8510-581cb33826b6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:40.210935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504f07-1613-46d6-8510-581cb33826b6 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:40.212640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 519/1016] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:40.216234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96eade-a8a9-400d-874c-db6d465ac7ab None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:40.217978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59edc8-40b6-4f16-b5c2-4de825c28a25 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:40.218241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59edc8-40b6-4f16-b5c2-4de825c28a25 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:40.218526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59edc8-40b6-4f16-b5c2-4de825c28a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:40.235768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4b59edc8-40b6-4f16-b5c2-4de825c28a25 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:40.236974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4b59edc8-40b6-4f16-b5c2-4de825c28a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:40.302915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 520/1017] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:40 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:40.315123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96eade-a8a9-400d-874c-db6d465ac7ab None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:40.325845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59edc8-40b6-4f16-b5c2-4de825c28a25 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:40.348488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:40.349082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:40.349362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:40.349640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:40.350365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:40.351751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:40.365731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 498/1018] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:40 2022] POST /identity/v3/services => generated 242 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:40.427466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59edc8-40b6-4f16-b5c2-4de825c28a25 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:40.474598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236eaad-8f19-4b56-8f09-181917554282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:40.475811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236eaad-8f19-4b56-8f09-181917554282 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:40.476353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236eaad-8f19-4b56-8f09-181917554282 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:40.476635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236eaad-8f19-4b56-8f09-181917554282 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:40.478079 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236eaad-8f19-4b56-8f09-181917554282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:40.479546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236eaad-8f19-4b56-8f09-181917554282 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:40.481487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 521/1019] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:40.487456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:40.595901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc497c-1e85-4e31-abca-05d3714c4487 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:40.628087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43664b-7e29-4595-a309-f8f5a7d19d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:40.628656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43664b-7e29-4595-a309-f8f5a7d19d0f None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:40.628937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43664b-7e29-4595-a309-f8f5a7d19d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:40.629210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43664b-7e29-4595-a309-f8f5a7d19d0f None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:40.629912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43664b-7e29-4595-a309-f8f5a7d19d0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:40.631358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43664b-7e29-4595-a309-f8f5a7d19d0f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:40.658464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 499/1020] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:41:40 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:41.193068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d236-001d-490b-8eca-80e33e5f9b4b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:41.193648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d236-001d-490b-8eca-80e33e5f9b4b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:41.193648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d236-001d-490b-8eca-80e33e5f9b4b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:41.194927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 522/1021] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:41.200787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea972d6-e4c6-4372-a485-1b2002f9530d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:41.201239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea972d6-e4c6-4372-a485-1b2002f9530d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:41.201343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea972d6-e4c6-4372-a485-1b2002f9530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:41.217972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7ea972d6-e4c6-4372-a485-1b2002f9530d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:41.219183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7ea972d6-e4c6-4372-a485-1b2002f9530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:41.287543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 500/1022] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:41.310493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9d236-001d-490b-8eca-80e33e5f9b4b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:41.412397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9d236-001d-490b-8eca-80e33e5f9b4b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:41.447696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:41.448483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:41.448764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:41.449039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:41.459469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:41.467664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:41.469315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:41.470998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:41.475313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 523/1023] 10.222.0.99 () {56 vars in 1120 bytes} [Fri May 13 14:41:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:41.476628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea972d6-e4c6-4372-a485-1b2002f9530d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:41.586621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea972d6-e4c6-4372-a485-1b2002f9530d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:41.620525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:41.621194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:41.621474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:41.621745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:41.622492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:41.622801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:41.624214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:41.632310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 501/1024] 10.222.0.99 () {56 vars in 1115 bytes} [Fri May 13 14:41:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:41.637953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:41.733390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fcdd-a892-462b-af4a-b2375deff9bd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:41.765379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:41.766163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:41.766444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:41.766717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:41.777456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:41.778903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:41.795642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:41.796596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:41.797497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:41.797497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:41.797497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:41.797497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:41.800214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 524/1025] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:41.802533 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:41.906339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e898079-4ea5-4702-8ad5-36910617e7ab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:41.940182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:41.941234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:41.941735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:41.942212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:41.943127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:41.943650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:41.945402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:41.958379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 502/1026] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:41.963909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.064835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466acc0-360c-4f72-85ef-b25cc8fa02a7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:42.099070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:42.099862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.100160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.100431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.108162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:42.110281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:42.126235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:42.127260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:42.128280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:42.132284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 525/1027] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:41:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:42.133814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.233004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140060dc-2977-4c0c-a759-8e63213d62c8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:42.267560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bbca5-56e1-40b3-8eb6-b89ed2c904d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:42.268260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbca5-56e1-40b3-8eb6-b89ed2c904d0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.268536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbca5-56e1-40b3-8eb6-b89ed2c904d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.268805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbca5-56e1-40b3-8eb6-b89ed2c904d0 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.269630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bbca5-56e1-40b3-8eb6-b89ed2c904d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:42.269932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bbca5-56e1-40b3-8eb6-b89ed2c904d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:42.271433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bbca5-56e1-40b3-8eb6-b89ed2c904d0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:42.288700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 503/1028] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:41:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:42.294471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.392621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30581-3378-4245-95f0-49bd5267258b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:42.428494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5c86b-828a-4137-b5f7-de1f49ceaefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:42.429166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c86b-828a-4137-b5f7-de1f49ceaefe None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.429442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c86b-828a-4137-b5f7-de1f49ceaefe None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.429708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c86b-828a-4137-b5f7-de1f49ceaefe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.504211 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5c86b-828a-4137-b5f7-de1f49ceaefe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:42.505687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5c86b-828a-4137-b5f7-de1f49ceaefe None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:42.604280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735af397-d5a4-4114-be0a-fcefb149a0f2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.604616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735af397-d5a4-4114-be0a-fcefb149a0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.604841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735af397-d5a4-4114-be0a-fcefb149a0f2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.605498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 526/1029] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:42.606288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 504/1030] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:42.611103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735af397-d5a4-4114-be0a-fcefb149a0f2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.611412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8dc21-dabd-41d4-882b-a3d1fb337876 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.611699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8dc21-dabd-41d4-882b-a3d1fb337876 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.612006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8dc21-dabd-41d4-882b-a3d1fb337876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.627534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-18b8dc21-dabd-41d4-882b-a3d1fb337876 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:42.628722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-18b8dc21-dabd-41d4-882b-a3d1fb337876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:42.694188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 527/1031] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:42.712755 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735af397-d5a4-4114-be0a-fcefb149a0f2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:42.716355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8dc21-dabd-41d4-882b-a3d1fb337876 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.746753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:42.747564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.747844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.748145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.759507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:42.761166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:42.780383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:42.781402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:42.787526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:42.787526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:42.787526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:42.787526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:42.787526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 505/1032] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:42.787526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.817327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8dc21-dabd-41d4-882b-a3d1fb337876 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:42.853732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:42.854526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.854805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.855077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] PATH_INFO: `/v3/services/image` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.855723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:42.857124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:42.868765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:42.870317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:42.871187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:42.875365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 528/1033] 10.222.0.99 () {56 vars in 1105 bytes} [Fri May 13 14:41:42 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:42.876225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.902173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a989dc7-189e-4a1c-92ca-43085bfcbf99 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:42.935699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885197-8053-4a67-bad9-88686f76bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:42.936389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885197-8053-4a67-bad9-88686f76bc92 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.936724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885197-8053-4a67-bad9-88686f76bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.937056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885197-8053-4a67-bad9-88686f76bc92 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.937835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885197-8053-4a67-bad9-88686f76bc92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:42.938137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885197-8053-4a67-bad9-88686f76bc92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:42.939732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885197-8053-4a67-bad9-88686f76bc92 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:42.956246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 506/1034] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:42.956246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59713203-834f-4769-be73-8e0642e1398e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:42.956246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59713203-834f-4769-be73-8e0642e1398e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:42.956246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59713203-834f-4769-be73-8e0642e1398e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:42.956246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 507/1035] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:42.957167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59713203-834f-4769-be73-8e0642e1398e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:42.972433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a826c7-7489-469a-87bd-dc2bb4fdf76c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.007785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734960a5-466a-46a8-9a29-dbd0e33bf9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.008564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734960a5-466a-46a8-9a29-dbd0e33bf9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.008847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734960a5-466a-46a8-9a29-dbd0e33bf9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.009120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734960a5-466a-46a8-9a29-dbd0e33bf9d5 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.009824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734960a5-466a-46a8-9a29-dbd0e33bf9d5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:43.010128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734960a5-466a-46a8-9a29-dbd0e33bf9d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.011497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734960a5-466a-46a8-9a29-dbd0e33bf9d5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.016208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 529/1036] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:43.017372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af41fe-afdd-4778-b0fd-3e71724bd3d7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.017659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af41fe-afdd-4778-b0fd-3e71724bd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.017936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af41fe-afdd-4778-b0fd-3e71724bd3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.034723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d2af41fe-afdd-4778-b0fd-3e71724bd3d7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:43.035981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d2af41fe-afdd-4778-b0fd-3e71724bd3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:43.060227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59713203-834f-4769-be73-8e0642e1398e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.092441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.093273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.093554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.093824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.100978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 530/1037] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:43.101114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.101846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af41fe-afdd-4778-b0fd-3e71724bd3d7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:43.102455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:43.116923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:43.118141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:43.119039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 508/1038] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:43.123805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:43.199484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af41fe-afdd-4778-b0fd-3e71724bd3d7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.221448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae608fd-e280-4946-ae52-103ecd3e5c06 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.234291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.234889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.235176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.235430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.236165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:43.236471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.237857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.242565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 531/1039] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:43.243518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:43.261666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.262334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.262620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.262891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.263669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:43.264008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.265465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.281967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 509/1040] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:43.281967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:43.339363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a01af-a478-4015-9178-51c2961fe1c1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.372001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.372804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.373081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.373364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.374529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.375996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.376809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341cb69-cc04-4694-b852-2498dfba3a70 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.377616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 532/1041] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:43.378375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:43.410063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.410720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.411002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.411275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.412080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] RBAC: Adding query filter params (interface=public, service_id=6ecfa2af2919462ca733d4deb57c2ff6, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:43.412388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.413758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.418950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 510/1042] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:41:43 2022] GET /identity/v3/endpoints?service_id=6ecfa2af2919462ca733d4deb57c2ff6&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:43.419803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:43.471176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5787c-a29a-417f-92b8-e8b509e005f3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.504803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.505496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.505782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.506059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.506897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] RBAC: Adding query filter params (role.id=dd610af9853e48bbbefddeffa0837860, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=38f74d30b6da44cb8f60e87f44da4ff5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:43.507210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.509048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.516234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5e7d-c579-45c5-8113-9a83cbf1da24 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.518092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 533/1043] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:43 2022] GET /identity/v3/role_assignments?user.id=38f74d30b6da44cb8f60e87f44da4ff5&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=dd610af9853e48bbbefddeffa0837860 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:43.518892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:43.568146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76e8f2-97a3-48ab-aa07-b0311949ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.568834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76e8f2-97a3-48ab-aa07-b0311949ddbf None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.569118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76e8f2-97a3-48ab-aa07-b0311949ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.569396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76e8f2-97a3-48ab-aa07-b0311949ddbf None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.570111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76e8f2-97a3-48ab-aa07-b0311949ddbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.571714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76e8f2-97a3-48ab-aa07-b0311949ddbf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.595716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 511/1044] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:41:43 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:43.640268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4294a6-0c80-4ea7-bd86-a83a86be054a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:43.681302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9307a5-f109-4e76-9024-69683282ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:43.682381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9307a5-f109-4e76-9024-69683282ab0d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:43.682863 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9307a5-f109-4e76-9024-69683282ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:43.683288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9307a5-f109-4e76-9024-69683282ab0d None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:43.684187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9307a5-f109-4e76-9024-69683282ab0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:43.685798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9307a5-f109-4e76-9024-69683282ab0d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:43.694057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 534/1045] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:41:43 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:41:45.720174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b65e7a-b8d5-458f-86a3-b410d7ac06bd None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:45.720719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b65e7a-b8d5-458f-86a3-b410d7ac06bd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:45.720719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b65e7a-b8d5-458f-86a3-b410d7ac06bd None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:45.722104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 512/1046] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:45.727932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644ae78-f1e3-4ba1-95f7-f0ad9a839aee None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:45.728704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644ae78-f1e3-4ba1-95f7-f0ad9a839aee None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:45.728991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644ae78-f1e3-4ba1-95f7-f0ad9a839aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:45.746347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7644ae78-f1e3-4ba1-95f7-f0ad9a839aee None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:45.747528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7644ae78-f1e3-4ba1-95f7-f0ad9a839aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:45.820630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 535/1047] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:45.846683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b65e7a-b8d5-458f-86a3-b410d7ac06bd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:45.875960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce7879-6a39-4b44-bbcd-95dd40dc71e6 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:45.876272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce7879-6a39-4b44-bbcd-95dd40dc71e6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:45.876537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce7879-6a39-4b44-bbcd-95dd40dc71e6 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:45.877914 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 536/1048] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:45.883267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ffe8-fd20-42eb-a26e-117ffa108f83 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:45.883571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ffe8-fd20-42eb-a26e-117ffa108f83 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:45.883824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ffe8-fd20-42eb-a26e-117ffa108f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:45.900876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bd31ffe8-fd20-42eb-a26e-117ffa108f83 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:45.901940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bd31ffe8-fd20-42eb-a26e-117ffa108f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:45.954550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b65e7a-b8d5-458f-86a3-b410d7ac06bd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:45.966947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 537/1049] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:45.968483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333176d-275b-481e-be35-a4e1c4fb8c63 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:45.968770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333176d-275b-481e-be35-a4e1c4fb8c63 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:45.969050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333176d-275b-481e-be35-a4e1c4fb8c63 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:45.970714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 538/1050] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:45.975719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdfc5-250e-4bf6-8da7-aab6c5c58aab None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:45.976050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdfc5-250e-4bf6-8da7-aab6c5c58aab None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:45.976330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdfc5-250e-4bf6-8da7-aab6c5c58aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:45.988397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:45.989216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:45.989500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:45.989776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:45.992868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-065fdfc5-250e-4bf6-8da7-aab6c5c58aab None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:45.994040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-065fdfc5-250e-4bf6-8da7-aab6c5c58aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:46.000893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:46.009256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:46.010409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 513/1051] 10.222.0.99 () {56 vars in 1120 bytes} [Fri May 13 14:41:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:46.011651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.062556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 539/1052] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:46.063768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fdfc5-250e-4bf6-8da7-aab6c5c58aab None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.110578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2473-189c-4fef-868e-0cb91547436d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.143253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.144124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.144406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.144686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.155040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:46.162579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:46.163640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:46.164802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:46.165498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fdfc5-250e-4bf6-8da7-aab6c5c58aab None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.165573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 514/1053] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:46.165573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.197468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.198263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.198546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.198820 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.199559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:46.199860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.201262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.209373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 540/1054] 10.222.0.99 () {56 vars in 1115 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:46.210159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.261563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85889493-0164-4a19-9fe5-8b46a8695a66 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.294870 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.295667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.296035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.296311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] PATH_INFO: `/v3/services/image` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.296963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.298384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.306548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329e621-0ab1-4497-ad27-b9fc2015384b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:46.310024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:46.311038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:46.312144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 515/1055] 10.222.0.99 () {56 vars in 1105 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:46.313165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.342232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.343078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.343508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.343892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.345224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:46.345586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.347305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.356264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 541/1056] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:46.357038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.411946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444da785-7527-4765-8e6c-1812b247b10b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.445811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.446624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.446901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.447175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.450600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f78b-df05-447b-969c-757433dad9f1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.457628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.459085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:46.476153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:46.477287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:46.478265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:46.478265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:46.478265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:46.478265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:46.478265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 516/1057] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:46.478846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.490687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.491320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.491604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.491890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.492678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] RBAC: Adding query filter params (name=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:46.493180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.494586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.500481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 542/1058] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:46.501631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.576799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ebca8-9c8e-4a84-bace-0d76dd9d0081 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.599116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251732-deb0-41b2-a6f8-5c09da710432 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.610059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.610923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.611188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.611454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] PATH_INFO: `/v3/users/bbf9992e5b424b0fbb52318d4e914c5a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.624650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] RBAC: Authorizing `identity:get_user(user_id=bbf9992e5b424b0fbb52318d4e914c5a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.626090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.627935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 517/1059] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/users/bbf9992e5b424b0fbb52318d4e914c5a => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:46.628527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.631546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.632325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.632605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.632923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.633647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:46.633951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.635434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.652515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 543/1060] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:46.652515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.719707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e3261-9929-40fb-830e-2abbb644f02c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.745558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed276ad-a476-4b58-8828-749ada979801 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.753279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.753938 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.754217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.754495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.755193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] RBAC: Adding query filter params (type=image) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:46.755500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.756911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.761690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 518/1061] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:46.762428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.778916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.779574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.779857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.780155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.846470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.847934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.862078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcca2e8-fb8e-42d0-a9c0-eeb271d59862 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:46.896021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:46.896822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:46.897101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:46.897377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:46.904226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:46.905636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:46.919905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:46.921093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 519/1062] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:46.922071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:46.953151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 544/1063] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:46.953151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.022841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326886-5775-488c-be79-68ad4a29ec3d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.046601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73db3-15c6-4f07-a833-cabbaf41b9df None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.055858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.056538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.056821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.057095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.057824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.059219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.077517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 520/1064] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:41:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:47.078323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.095738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.096509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.096792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.097122 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.097983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:47.098341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.099827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.124326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 545/1065] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:41:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:47.125591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.186060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433e54-4ee8-4300-9190-2701fd755562 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.221395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.222280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.222560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.222839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.224083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] RBAC: Authorizing `identity:get_project(project_id=a698c890330d4ec9b7ba14fde628b0ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.225551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.227498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 521/1066] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:41:47 2022] GET /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:47.230779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5386890-c0c2-48c6-9414-b503ed4c5c7f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.233580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.267347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.267821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.268147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.269089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.279482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.281017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:47.299098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:47.300124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:47.301317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:47.301317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:47.301317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:47.301317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:47.301317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 546/1067] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:47.306333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.332832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ba81-6b4b-43ea-9ebc-fdb285f2df67 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.366020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.366679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.366995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.367274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.368119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=a698c890330d4ec9b7ba14fde628b0ae, user.id=bbf9992e5b424b0fbb52318d4e914c5a) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:47.368428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.369865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.375396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 522/1068] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:47 2022] GET /identity/v3/role_assignments?user.id=bbf9992e5b424b0fbb52318d4e914c5a&scope.project.id=a698c890330d4ec9b7ba14fde628b0ae&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:47.404149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91725-80b7-466f-9e21-3a220fe13081 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.439612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.440376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.440656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.440929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.441727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:47.442030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.443444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.460840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 547/1069] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:47.462553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.568419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b6e1-a5b9-415a-92d5-ed830f5e93a5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.602358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.603160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.603442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.603770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.610582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.612076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:47.626243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:47.627216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:47.628196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:47.629162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 523/1070] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:47.633646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.732599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39777986-07c7-4d08-8d0f-3f809b0c038f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.765836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3e975-1fe8-40fa-bf23-53eb328eb224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.766510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e975-1fe8-40fa-bf23-53eb328eb224 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.766744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e975-1fe8-40fa-bf23-53eb328eb224 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.767025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e975-1fe8-40fa-bf23-53eb328eb224 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.767809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e975-1fe8-40fa-bf23-53eb328eb224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:47.768144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e975-1fe8-40fa-bf23-53eb328eb224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.769570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e975-1fe8-40fa-bf23-53eb328eb224 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.781796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 548/1071] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:47.787675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:47.886976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e14d1-6b86-4ffd-bda9-e3984f873606 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:47.920847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b805d7-6932-49f9-b9c1-5e292d739eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:47.921732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b805d7-6932-49f9-b9c1-5e292d739eda None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:47.922009 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b805d7-6932-49f9-b9c1-5e292d739eda None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:47.922276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b805d7-6932-49f9-b9c1-5e292d739eda None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/38f74d30b6da44cb8f60e87f44da4ff5/roles/dd610af9853e48bbbefddeffa0837860` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:47.924504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b805d7-6932-49f9-b9c1-5e292d739eda None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=38f74d30b6da44cb8f60e87f44da4ff5, role_id=dd610af9853e48bbbefddeffa0837860)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:47.925957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b805d7-6932-49f9-b9c1-5e292d739eda None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:47.939688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 524/1072] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:41:47 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/38f74d30b6da44cb8f60e87f44da4ff5/roles/dd610af9853e48bbbefddeffa0837860 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:41:49.315208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c07c65-363a-4210-a1bb-2c44f96b3098 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.315731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c07c65-363a-4210-a1bb-2c44f96b3098 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.315809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c07c65-363a-4210-a1bb-2c44f96b3098 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.317231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 549/1073] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:49.322991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7b06-a8b2-43b1-9216-83f15ebac64f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.323451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7b06-a8b2-43b1-9216-83f15ebac64f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.323531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7b06-a8b2-43b1-9216-83f15ebac64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.340596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-32fa7b06-a8b2-43b1-9216-83f15ebac64f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:49.341780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-32fa7b06-a8b2-43b1-9216-83f15ebac64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:49.411270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 525/1074] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:49.432959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c07c65-363a-4210-a1bb-2c44f96b3098 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:49.539016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c07c65-363a-4210-a1bb-2c44f96b3098 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:49.569165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9eac2-b2b5-414b-867c-9f3b601c6d8f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.569345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9eac2-b2b5-414b-867c-9f3b601c6d8f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.569618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9eac2-b2b5-414b-867c-9f3b601c6d8f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.571229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 526/1075] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:49.574565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:49.575363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.575651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.575986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.576412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e725fb-4f51-434d-97ed-4a8e178765d6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.576798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e725fb-4f51-434d-97ed-4a8e178765d6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.577177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e725fb-4f51-434d-97ed-4a8e178765d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.593675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-74e725fb-4f51-434d-97ed-4a8e178765d6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:49.595159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74e725fb-4f51-434d-97ed-4a8e178765d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:49.647764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:49.649288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:49.661886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 527/1076] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:49.684161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e725fb-4f51-434d-97ed-4a8e178765d6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:49.743620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 550/1077] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:49.749500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:49.778084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e725fb-4f51-434d-97ed-4a8e178765d6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:49.811118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:49.811937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.812217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.812488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.822493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:49.830415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:49.831371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:49.832296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 528/1078] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:49.837820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:49.848779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ccd65-77e2-4ca8-9e4d-a72c854f659c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:49.882541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:49.883444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.883903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.884222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.894449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:49.896071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:49.915429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:49.916471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:49.917383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:49.917383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:49.917383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:49.917383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:49.917383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 551/1079] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:41:49.922483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:49.940357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4599-2c7d-4cd3-8bb9-3e1080b2e285 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:49.977443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:49.978138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:49.978813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:49.978813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:49.979433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:49.979739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:49.981250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:49.995657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 529/1080] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:49.996749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:50.029180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aa03a-8c32-47ae-8ac5-ba6559a7e706 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.062124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f296f-e433-45b5-b700-f711ad63896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.062790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f296f-e433-45b5-b700-f711ad63896d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.063076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f296f-e433-45b5-b700-f711ad63896d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.063352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f296f-e433-45b5-b700-f711ad63896d None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.064107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f296f-e433-45b5-b700-f711ad63896d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:50.064414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f296f-e433-45b5-b700-f711ad63896d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:50.065794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f296f-e433-45b5-b700-f711ad63896d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:50.076896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 552/1081] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:50.119263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e234-5e8f-4f6b-b1d9-87668d109bb6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.148620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe322-7601-4efa-a1da-e8b577a6f2dd None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.148870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe322-7601-4efa-a1da-e8b577a6f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.149157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe322-7601-4efa-a1da-e8b577a6f2dd None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.150747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 553/1082] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:41:50.156255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe95e4-1378-44ff-b4ff-0caa6c1dd517 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.156568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe95e4-1378-44ff-b4ff-0caa6c1dd517 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.156794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe95e4-1378-44ff-b4ff-0caa6c1dd517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.160255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.161164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.161443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.161969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] PATH_INFO: `/v3/users/bbf9992e5b424b0fbb52318d4e914c5a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.163232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf9992e5b424b0fbb52318d4e914c5a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:50.165494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:50.167409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 530/1083] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:41:49 2022] GET /identity/v3/users/bbf9992e5b424b0fbb52318d4e914c5a => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:50.173151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:50.174783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c8fe95e4-1378-44ff-b4ff-0caa6c1dd517 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:50.175988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c8fe95e4-1378-44ff-b4ff-0caa6c1dd517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:50.251911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 554/1084] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:50.275712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe95e4-1378-44ff-b4ff-0caa6c1dd517 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:50.276713 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aa6cb-2037-4579-bcfe-d341ec417386 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.311297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.312274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.312553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.312825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.314029 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] RBAC: Authorizing `identity:get_project(project_id=a698c890330d4ec9b7ba14fde628b0ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:50.315473 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:50.317227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 531/1085] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:41:50 2022] GET /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:50.323234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:50.377551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe95e4-1378-44ff-b4ff-0caa6c1dd517 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.410591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.411406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.411685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.411997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.421748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbbf45-3f41-4d76-bb16-af77b9c2fb33 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.422447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:50.430550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:50.431584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:50.432469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 555/1086] 10.222.0.99 () {56 vars in 1120 bytes} [Fri May 13 14:41:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:50.437722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:50.453779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.454676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.454987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.455264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae/users/bbf9992e5b424b0fbb52318d4e914c5a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.457230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] RBAC: Authorizing `identity:create_grant(project_id=a698c890330d4ec9b7ba14fde628b0ae, user_id=bbf9992e5b424b0fbb52318d4e914c5a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:50.458671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:50.471958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 532/1087] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:41:50 2022] PUT /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae/users/bbf9992e5b424b0fbb52318d4e914c5a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:41:50.541584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dd1e3-d541-44de-929e-1458b97c504d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.579222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.579904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.580231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.580504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.581270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:50.581581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:50.582963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:50.592102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 556/1088] 10.222.0.99 () {56 vars in 1115 bytes} [Fri May 13 14:41:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:41:50.598284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:50.704861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b9a9-7e5a-4928-874a-f562b0b86dab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.738844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.739631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.739904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.740214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.750451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:50.751899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:50.769008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:50.769916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:50.770810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:50.770810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:50.770810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:50.770810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:50.770810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 533/1089] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:50.776510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:50.876285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc2128-1c4b-4cef-a354-5455158d90c8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:50.909635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:50.910291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:50.910569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:50.910836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:50.911549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:50.911850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:50.913246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:50.924963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 557/1090] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:50.930903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:51.033201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3742e2-7c20-47a9-bbd8-06c00a53dbab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:51.067047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:51.067849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:51.068158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:51.068431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:51.076335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:51.077786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:41:51.092089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:51.093057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:51.094201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 534/1091] 10.222.0.99 () {56 vars in 1093 bytes} [Fri May 13 14:41:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:51.099692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:51.195611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc11102-86df-49d1-801f-ddd4384dd789 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:51.229772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:51.230444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:51.230720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:51.230986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:51.231817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:51.232167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:51.233626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:51.251468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 558/1092] 10.222.0.99 () {56 vars in 1133 bytes} [Fri May 13 14:41:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:51.257213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:51.358540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99b0b-0738-4318-899d-ba5767fb6288 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:51.392746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:51.393392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:51.393666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:51.393940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:51.456093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:51.457576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:51.567044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 535/1093] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:51.573331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:51.678979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec2e4b-7466-4a61-8da5-83a02f336c75 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:51.712999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:51.713805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:51.714086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:51.714359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:51.724959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:51.726416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:41:51.743630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:51.744593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:51.745524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:41:51.745524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:41:51.745524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:41:51.745524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:51.745524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 559/1094] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:51.750623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:51.847621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2c166-8baf-40a8-b130-27e21a2d0c61 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:51.880554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:51.881204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:51.881482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:51.881754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:51.882493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:51.882863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:51.884287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:51.895329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 536/1095] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:51.901073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:51.999522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a4e10-e626-4872-a45f-a8b432996a84 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:52.033459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:52.034231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:52.034541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:52.034804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:52.041600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:52.043042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:41:52.056449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:52.057358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:41:52.058417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 560/1096] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:52.063589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:52.166935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed761a-0b67-4bb6-982d-43cc23c62756 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:52.200688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe830-fff0-4486-b69c-4d5f7af4fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:52.201344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe830-fff0-4486-b69c-4d5f7af4fb09 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:52.201628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe830-fff0-4486-b69c-4d5f7af4fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:52.201901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe830-fff0-4486-b69c-4d5f7af4fb09 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:52.202663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe830-fff0-4486-b69c-4d5f7af4fb09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:52.202971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe830-fff0-4486-b69c-4d5f7af4fb09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:52.204465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe830-fff0-4486-b69c-4d5f7af4fb09 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:52.216848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 537/1097] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:52.223342 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:52.321680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3c511-6c86-4795-be66-93263325b82c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:52.355484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d8f97-5efd-4f1a-bf57-e56c33809e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:52.356159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8f97-5efd-4f1a-bf57-e56c33809e84 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:52.356436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8f97-5efd-4f1a-bf57-e56c33809e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:52.356706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8f97-5efd-4f1a-bf57-e56c33809e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:52.357534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8f97-5efd-4f1a-bf57-e56c33809e84 None admin] RBAC: Adding query filter params (role.id=dd610af9853e48bbbefddeffa0837860, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=38f74d30b6da44cb8f60e87f44da4ff5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:52.357844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8f97-5efd-4f1a-bf57-e56c33809e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:52.359269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8f97-5efd-4f1a-bf57-e56c33809e84 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:52.365321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 561/1098] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:52 2022] GET /identity/v3/role_assignments?user.id=38f74d30b6da44cb8f60e87f44da4ff5&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=dd610af9853e48bbbefddeffa0837860 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:52.641704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57993-b28a-4019-a1ce-6cd68420258c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:52.642182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57993-b28a-4019-a1ce-6cd68420258c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:52.642182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57993-b28a-4019-a1ce-6cd68420258c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:52.643519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 538/1099] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:52.649361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf8f0-2db1-41f0-9d5d-d555358395d0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:52.649778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf8f0-2db1-41f0-9d5d-d555358395d0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:52.649922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf8f0-2db1-41f0-9d5d-d555358395d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:52.667943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-500cf8f0-2db1-41f0-9d5d-d555358395d0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:52.669161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-500cf8f0-2db1-41f0-9d5d-d555358395d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:52.739444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 562/1100] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:52.762733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57993-b28a-4019-a1ce-6cd68420258c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:52.864759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57993-b28a-4019-a1ce-6cd68420258c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:52.899045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:52.900023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:52.900306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:52.900577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:52.910992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:41:52.918928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:41:52.919928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:41:52.920811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 539/1101] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:41:52.926241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cf8f0-2db1-41f0-9d5d-d555358395d0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:53.027279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cf8f0-2db1-41f0-9d5d-d555358395d0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:53.069052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:53.070350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:53.070633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:53.070908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:53.071675 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:53.071965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:53.073345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:53.082338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 563/1102] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:53.089131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:53.194846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c867fb-e01f-4d1e-89f1-18069081713f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:53.231230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:53.232125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:53.232432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:53.232678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] PATH_INFO: `/v3/users/bbf9992e5b424b0fbb52318d4e914c5a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:53.233867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf9992e5b424b0fbb52318d4e914c5a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:53.235339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:53.237319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 540/1103] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:41:53 2022] GET /identity/v3/users/bbf9992e5b424b0fbb52318d4e914c5a => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:53.244024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:53.356014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbd6fb-64b2-4c96-93f6-55489b2291cb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:53.388764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:53.389396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:53.389674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:53.389940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:53.454822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:53.456217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:53.568291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 564/1104] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:53.577374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:53.686400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b2b3b-f984-4498-8e3e-e4d2e35b5d98 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:53.720480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b3e4f-7312-4805-a980-5da58404e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:53.721328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b3e4f-7312-4805-a980-5da58404e12a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:53.721608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b3e4f-7312-4805-a980-5da58404e12a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:53.721881 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b3e4f-7312-4805-a980-5da58404e12a None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:53.723107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b3e4f-7312-4805-a980-5da58404e12a None admin] RBAC: Authorizing `identity:get_project(project_id=a698c890330d4ec9b7ba14fde628b0ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:53.724617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b3e4f-7312-4805-a980-5da58404e12a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:53.726478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 541/1105] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:41:53 2022] GET /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:53.732715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:53.837360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343857a-ea98-4906-93ca-6bce11b0eca4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:53.873160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04a5ba-cc0f-4421-a2b3-62f60c427442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:53.873807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04a5ba-cc0f-4421-a2b3-62f60c427442 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:53.874094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04a5ba-cc0f-4421-a2b3-62f60c427442 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:53.874370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04a5ba-cc0f-4421-a2b3-62f60c427442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:53.875200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04a5ba-cc0f-4421-a2b3-62f60c427442 None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=a698c890330d4ec9b7ba14fde628b0ae, user.id=bbf9992e5b424b0fbb52318d4e914c5a) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:53.875509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04a5ba-cc0f-4421-a2b3-62f60c427442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:53.876975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04a5ba-cc0f-4421-a2b3-62f60c427442 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:53.882815 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 565/1106] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:53 2022] GET /identity/v3/role_assignments?user.id=bbf9992e5b424b0fbb52318d4e914c5a&scope.project.id=a698c890330d4ec9b7ba14fde628b0ae&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:56.115599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c23c-6480-4c54-a3ff-21a55bb0486b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:56.116681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c23c-6480-4c54-a3ff-21a55bb0486b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:56.116681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c23c-6480-4c54-a3ff-21a55bb0486b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:56.118613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 542/1107] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:56.124360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3064-20d4-4764-a43f-cc794824cb0b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:56.124814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3064-20d4-4764-a43f-cc794824cb0b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:56.124916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3064-20d4-4764-a43f-cc794824cb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:56.143111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cf3b3064-20d4-4764-a43f-cc794824cb0b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:56.144305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cf3b3064-20d4-4764-a43f-cc794824cb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:56.210314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 566/1108] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:41:56.235675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61c23c-6480-4c54-a3ff-21a55bb0486b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:56.342391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61c23c-6480-4c54-a3ff-21a55bb0486b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:56.378390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e289d-fdba-4e8a-b4f6-677cfc565187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:56.379148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e289d-fdba-4e8a-b4f6-677cfc565187 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:56.379453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e289d-fdba-4e8a-b4f6-677cfc565187 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:56.379723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e289d-fdba-4e8a-b4f6-677cfc565187 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:56.380969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e289d-fdba-4e8a-b4f6-677cfc565187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:56.382498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e289d-fdba-4e8a-b4f6-677cfc565187 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:56.384154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 543/1109] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:41:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:56.391368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b3064-20d4-4764-a43f-cc794824cb0b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:56.503187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b3064-20d4-4764-a43f-cc794824cb0b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:56.541342 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3850eb9-1db7-4ab9-86ce-acda27434e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:56.542021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850eb9-1db7-4ab9-86ce-acda27434e63 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:56.542301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850eb9-1db7-4ab9-86ce-acda27434e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:56.542580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850eb9-1db7-4ab9-86ce-acda27434e63 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:56.543286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3850eb9-1db7-4ab9-86ce-acda27434e63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:56.544765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3850eb9-1db7-4ab9-86ce-acda27434e63 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:56.565909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 567/1110] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:41:56 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:41:58.782471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b038f8-1f53-4eff-a579-96b867978fe6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:58.783312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b038f8-1f53-4eff-a579-96b867978fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:58.783312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b038f8-1f53-4eff-a579-96b867978fe6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:58.785505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 544/1111] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:41:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:41:58.791308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354bca-ecb5-43de-a0ee-4f72fcaf88de None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:58.791741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354bca-ecb5-43de-a0ee-4f72fcaf88de None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:58.791831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354bca-ecb5-43de-a0ee-4f72fcaf88de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:58.810648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8b354bca-ecb5-43de-a0ee-4f72fcaf88de None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:41:58.811842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8b354bca-ecb5-43de-a0ee-4f72fcaf88de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:41:58.893319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 568/1112] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:41:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:41:58.924820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b038f8-1f53-4eff-a579-96b867978fe6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:59.035745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b038f8-1f53-4eff-a579-96b867978fe6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:59.082697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:59.083552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:59.083828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:59.084143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] PATH_INFO: `/v3/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:59.085732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] RBAC: Authorizing `identity:get_role(role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:59.087123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:59.088535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 545/1113] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:41:58 2022] GET /identity/v3/roles/926ac669ff214536b6ec0876b5669dbc => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:59.095722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b354bca-ecb5-43de-a0ee-4f72fcaf88de None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:59.207329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b354bca-ecb5-43de-a0ee-4f72fcaf88de None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:59.241621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:59.242483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:59.242760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:59.243011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] PATH_INFO: `/v3/users/d66f05069e9044d6b4fea34899ee378c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:59.255843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] RBAC: Authorizing `identity:get_user(user_id=d66f05069e9044d6b4fea34899ee378c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:59.257345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:59.258976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 569/1114] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:41:59 2022] GET /identity/v3/users/d66f05069e9044d6b4fea34899ee378c => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:59.268371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:59.371392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c675bcb-51ff-4acb-9376-c8691899bdb5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:59.405158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:59.405794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:59.406075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:59.406347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:59.476451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:59.477919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:59.575296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 546/1115] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:41:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:41:59.584877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:59.694520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143118-eee2-44a1-a333-229ae228a21a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:59.729314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0ba9-ef39-454a-bc05-2f0df984de16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:59.730170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0ba9-ef39-454a-bc05-2f0df984de16 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:59.730449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0ba9-ef39-454a-bc05-2f0df984de16 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:59.730719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0ba9-ef39-454a-bc05-2f0df984de16 None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:59.732043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0ba9-ef39-454a-bc05-2f0df984de16 None admin] RBAC: Authorizing `identity:get_project(project_id=a698c890330d4ec9b7ba14fde628b0ae)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:59.733482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0ba9-ef39-454a-bc05-2f0df984de16 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:59.735230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 570/1116] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:41:59 2022] GET /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:41:59.742531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:41:59.862196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceb28-a46d-40af-8ace-e93529948baa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:41:59.895715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810cfb4-8035-4feb-88c8-0e6c82991923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:41:59.896379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810cfb4-8035-4feb-88c8-0e6c82991923 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:41:59.896659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810cfb4-8035-4feb-88c8-0e6c82991923 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:41:59.896931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810cfb4-8035-4feb-88c8-0e6c82991923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:41:59.897935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810cfb4-8035-4feb-88c8-0e6c82991923 None admin] RBAC: Adding query filter params (role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=a698c890330d4ec9b7ba14fde628b0ae, user.id=d66f05069e9044d6b4fea34899ee378c) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:41:59.898245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810cfb4-8035-4feb-88c8-0e6c82991923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:41:59.899695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810cfb4-8035-4feb-88c8-0e6c82991923 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:41:59.905176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 547/1117] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:41:59 2022] GET /identity/v3/role_assignments?user.id=d66f05069e9044d6b4fea34899ee378c&scope.project.id=a698c890330d4ec9b7ba14fde628b0ae&role.id=926ac669ff214536b6ec0876b5669dbc => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:42:02.078872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ebdfd-0cc9-4893-9cac-cb041360d81c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:02.079759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ebdfd-0cc9-4893-9cac-cb041360d81c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:02.079759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ebdfd-0cc9-4893-9cac-cb041360d81c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:02.081963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 571/1118] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:02.088544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c155-218e-499f-994a-2ab854ffb486 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:02.089278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c155-218e-499f-994a-2ab854ffb486 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:02.089430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c155-218e-499f-994a-2ab854ffb486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:02.116807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7831c155-218e-499f-994a-2ab854ffb486 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:02.117997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7831c155-218e-499f-994a-2ab854ffb486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:02.187431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 548/1119] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:02.218112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ebdfd-0cc9-4893-9cac-cb041360d81c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:02.320036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ebdfd-0cc9-4893-9cac-cb041360d81c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:02.363082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:02.363901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:02.364197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:02.364475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] PATH_INFO: `/v3/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:02.366323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] RBAC: Authorizing `identity:get_role(role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:02.367713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:02.369138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 572/1120] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:02 2022] GET /identity/v3/roles/926ac669ff214536b6ec0876b5669dbc => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:02.377689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831c155-218e-499f-994a-2ab854ffb486 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:02.487348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831c155-218e-499f-994a-2ab854ffb486 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:02.537012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:02.538181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:02.538364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:02.538640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] PATH_INFO: `/v3/users/d66f05069e9044d6b4fea34899ee378c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:02.540002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] RBAC: Authorizing `identity:get_user(user_id=d66f05069e9044d6b4fea34899ee378c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:02.541477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:02.543131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 549/1121] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:02 2022] GET /identity/v3/users/d66f05069e9044d6b4fea34899ee378c => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:02.549798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:02.695365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5975c-56ff-419b-b4ad-38093bcce5be None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:02.731654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e408ba-b152-4c26-9f5c-b426736210ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:02.732539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e408ba-b152-4c26-9f5c-b426736210ab None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:02.732815 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e408ba-b152-4c26-9f5c-b426736210ab None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:02.733098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e408ba-b152-4c26-9f5c-b426736210ab None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:02.734281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e408ba-b152-4c26-9f5c-b426736210ab None admin] RBAC: Authorizing `identity:get_project(project_id=a698c890330d4ec9b7ba14fde628b0ae)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:02.735748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e408ba-b152-4c26-9f5c-b426736210ab None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:02.737466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 573/1122] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:02 2022] GET /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:42:02.744140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:02.872522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfdd50-bfbe-4cba-8718-c88f788a5688 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:02.906995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fb0fc-1ee4-480e-a09e-d08ea09b2f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:02.907906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fb0fc-1ee4-480e-a09e-d08ea09b2f9b None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:02.908187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fb0fc-1ee4-480e-a09e-d08ea09b2f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:02.908461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fb0fc-1ee4-480e-a09e-d08ea09b2f9b None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae/users/d66f05069e9044d6b4fea34899ee378c/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:02.911030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fb0fc-1ee4-480e-a09e-d08ea09b2f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=a698c890330d4ec9b7ba14fde628b0ae, user_id=d66f05069e9044d6b4fea34899ee378c, role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:02.912520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fb0fc-1ee4-480e-a09e-d08ea09b2f9b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:02.928905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 550/1123] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:42:02 2022] PUT /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae/users/d66f05069e9044d6b4fea34899ee378c/roles/926ac669ff214536b6ec0876b5669dbc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:42:05.087492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098cd3-c959-4980-99e4-36253dd555cd None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:05.088393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098cd3-c959-4980-99e4-36253dd555cd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:05.088500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098cd3-c959-4980-99e4-36253dd555cd None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:05.090657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 574/1124] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:05.097364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568415e6-80fe-4794-8b1c-d0fd0eb26584 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:05.098068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568415e6-80fe-4794-8b1c-d0fd0eb26584 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:05.098202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568415e6-80fe-4794-8b1c-d0fd0eb26584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:05.121867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-568415e6-80fe-4794-8b1c-d0fd0eb26584 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:05.123056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-568415e6-80fe-4794-8b1c-d0fd0eb26584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:05.189594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 551/1125] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:05.212918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098cd3-c959-4980-99e4-36253dd555cd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:05.318321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098cd3-c959-4980-99e4-36253dd555cd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:05.354274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:05.355055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:05.355332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:05.355598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] PATH_INFO: `/v3/roles/926ac669ff214536b6ec0876b5669dbc` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:05.357194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] RBAC: Authorizing `identity:get_role(role_id=926ac669ff214536b6ec0876b5669dbc)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:05.358545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:05.359905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 575/1126] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:05 2022] GET /identity/v3/roles/926ac669ff214536b6ec0876b5669dbc => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:05.366218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568415e6-80fe-4794-8b1c-d0fd0eb26584 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:05.460796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568415e6-80fe-4794-8b1c-d0fd0eb26584 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:05.494708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:05.495585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:05.495895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:05.496171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] PATH_INFO: `/v3/users/d66f05069e9044d6b4fea34899ee378c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:05.497393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] RBAC: Authorizing `identity:get_user(user_id=d66f05069e9044d6b4fea34899ee378c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:05.498837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:05.500488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 552/1127] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:05 2022] GET /identity/v3/users/d66f05069e9044d6b4fea34899ee378c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:05.506708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:05.615707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269094-bf0d-47a1-ab5d-bbc8828f9ee3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:05.648858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:05.649494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:05.649769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:05.650037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:05.719180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:05.720636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:05.816606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 576/1128] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:42:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:42:05.825303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:05.922504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce74dc-af69-437a-b3ff-2d3e23f7e4c5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:05.955986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fbc0-a97e-4389-9b72-1a52f1190693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:05.956835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fbc0-a97e-4389-9b72-1a52f1190693 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:05.957109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fbc0-a97e-4389-9b72-1a52f1190693 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:05.957340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fbc0-a97e-4389-9b72-1a52f1190693 None admin] PATH_INFO: `/v3/projects/a698c890330d4ec9b7ba14fde628b0ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:05.958636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3fbc0-a97e-4389-9b72-1a52f1190693 None admin] RBAC: Authorizing `identity:get_project(project_id=a698c890330d4ec9b7ba14fde628b0ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:05.960215 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3fbc0-a97e-4389-9b72-1a52f1190693 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:05.961926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 553/1129] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:05 2022] GET /identity/v3/projects/a698c890330d4ec9b7ba14fde628b0ae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:42:05.968840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:06.076363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112b7a-6ef6-42ea-aa5b-d42a4f142920 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:06.111888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72780d12-56ca-4d86-9c3d-83da5094e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:06.112510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780d12-56ca-4d86-9c3d-83da5094e357 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:06.112826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780d12-56ca-4d86-9c3d-83da5094e357 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:06.113101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780d12-56ca-4d86-9c3d-83da5094e357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:06.113924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72780d12-56ca-4d86-9c3d-83da5094e357 None admin] RBAC: Adding query filter params (role.id=926ac669ff214536b6ec0876b5669dbc, scope.project.id=a698c890330d4ec9b7ba14fde628b0ae, user.id=d66f05069e9044d6b4fea34899ee378c) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:06.114235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72780d12-56ca-4d86-9c3d-83da5094e357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:06.115688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72780d12-56ca-4d86-9c3d-83da5094e357 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:06.121543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 577/1130] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:42:05 2022] GET /identity/v3/role_assignments?user.id=d66f05069e9044d6b4fea34899ee378c&scope.project.id=a698c890330d4ec9b7ba14fde628b0ae&role.id=926ac669ff214536b6ec0876b5669dbc => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:08.312516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0779a12-bff6-4adc-9516-b4984f0bf847 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:08.313404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0779a12-bff6-4adc-9516-b4984f0bf847 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:08.313404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0779a12-bff6-4adc-9516-b4984f0bf847 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:08.315563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 554/1131] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:08.321969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900977b2-dd5d-47cd-bb45-d04e82a95992 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:08.322658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900977b2-dd5d-47cd-bb45-d04e82a95992 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:08.322824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900977b2-dd5d-47cd-bb45-d04e82a95992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:08.351033 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-900977b2-dd5d-47cd-bb45-d04e82a95992 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:08.352263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-900977b2-dd5d-47cd-bb45-d04e82a95992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:08.422850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 578/1132] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:08.449862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0779a12-bff6-4adc-9516-b4984f0bf847 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:08.573466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0779a12-bff6-4adc-9516-b4984f0bf847 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:08.608160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac30b6b-41d5-4fbe-9968-a942a342885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:08.608947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30b6b-41d5-4fbe-9968-a942a342885c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:08.609225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30b6b-41d5-4fbe-9968-a942a342885c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:08.609495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac30b6b-41d5-4fbe-9968-a942a342885c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:08.610708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30b6b-41d5-4fbe-9968-a942a342885c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:08.612190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac30b6b-41d5-4fbe-9968-a942a342885c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:08.613824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 555/1133] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:08.621114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900977b2-dd5d-47cd-bb45-d04e82a95992 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:08.733014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900977b2-dd5d-47cd-bb45-d04e82a95992 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:08.771949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15801adb-25c8-4a46-a0a2-99967d37fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:08.772601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801adb-25c8-4a46-a0a2-99967d37fd00 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:08.772878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801adb-25c8-4a46-a0a2-99967d37fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:08.773153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801adb-25c8-4a46-a0a2-99967d37fd00 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:08.773854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15801adb-25c8-4a46-a0a2-99967d37fd00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:08.775290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15801adb-25c8-4a46-a0a2-99967d37fd00 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:08.805909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 579/1134] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:42:08 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:42:11.043748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136162-b135-417a-8ea7-16c994456368 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:11.044497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136162-b135-417a-8ea7-16c994456368 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:11.044497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93136162-b135-417a-8ea7-16c994456368 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:11.045695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 556/1135] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:11.052500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42589c-c427-46f7-9aa8-b062870550e6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:11.053166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42589c-c427-46f7-9aa8-b062870550e6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:11.053363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42589c-c427-46f7-9aa8-b062870550e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:11.082132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bf42589c-c427-46f7-9aa8-b062870550e6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:11.084135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bf42589c-c427-46f7-9aa8-b062870550e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:11.162928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 580/1136] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:11.187433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93136162-b135-417a-8ea7-16c994456368 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:11.293057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93136162-b135-417a-8ea7-16c994456368 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:11.326910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15433f-6862-495d-b47f-462e09a12ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:11.327617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15433f-6862-495d-b47f-462e09a12ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:11.327907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15433f-6862-495d-b47f-462e09a12ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:11.328191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15433f-6862-495d-b47f-462e09a12ee9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:11.329415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15433f-6862-495d-b47f-462e09a12ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:11.330864 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15433f-6862-495d-b47f-462e09a12ee9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:11.332516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 557/1137] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:42:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:11.339374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42589c-c427-46f7-9aa8-b062870550e6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:11.441544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42589c-c427-46f7-9aa8-b062870550e6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:11.475171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47318fbc-2102-4d1b-bb11-c52729302848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:11.475846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318fbc-2102-4d1b-bb11-c52729302848 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:11.476147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318fbc-2102-4d1b-bb11-c52729302848 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:11.476415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47318fbc-2102-4d1b-bb11-c52729302848 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:11.477117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47318fbc-2102-4d1b-bb11-c52729302848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:11.478556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47318fbc-2102-4d1b-bb11-c52729302848 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:11.505649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 581/1138] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:42:11 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:42:13.739384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b789-00fb-4152-b5aa-b1f09fc9e861 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:13.740036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b789-00fb-4152-b5aa-b1f09fc9e861 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:13.740036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b789-00fb-4152-b5aa-b1f09fc9e861 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:13.741316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 558/1139] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:13.747679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b18611-a434-481f-bc44-ec2fd9b1f24d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:13.748476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b18611-a434-481f-bc44-ec2fd9b1f24d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:13.748618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b18611-a434-481f-bc44-ec2fd9b1f24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:13.768443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-92b18611-a434-481f-bc44-ec2fd9b1f24d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:13.769535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-92b18611-a434-481f-bc44-ec2fd9b1f24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:13.840189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 582/1140] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:13.864427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b789-00fb-4152-b5aa-b1f09fc9e861 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:13.969623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b789-00fb-4152-b5aa-b1f09fc9e861 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:14.003180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:14.003991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:14.004274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:14.004546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:14.014418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:42:14.022021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:42:14.023127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:42:14.024177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 559/1141] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:42:14.029633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b18611-a434-481f-bc44-ec2fd9b1f24d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:14.122145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b18611-a434-481f-bc44-ec2fd9b1f24d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:14.156471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:14.157130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:14.157406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:14.157681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:14.158429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:14.158738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:14.160142 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:14.168326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 583/1142] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:14.174373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:14.279179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec6694-0da1-4f3c-bde0-bf571bc58188 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:14.323486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:14.324365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:14.324649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:14.324921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] PATH_INFO: `/v3/users/eaa59ec288a84e66b5fb6a2322edbaa2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:14.340001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] RBAC: Authorizing `identity:get_user(user_id=eaa59ec288a84e66b5fb6a2322edbaa2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:14.341463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:14.343427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 560/1143] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:14 2022] GET /identity/v3/users/eaa59ec288a84e66b5fb6a2322edbaa2 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:14.351485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:14.455707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0fe4e-41bd-4d44-a975-e21af6839638 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:14.497706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:14.498354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:14.498634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:14.498906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:14.568237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:14.569602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:14.679753 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 584/1144] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:42:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:42:14.686551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:14.790908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d298b9a-8e3e-421c-b704-aaf138d7904f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:14.825933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7005ae-5659-40c4-8476-20771a674376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:14.826717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7005ae-5659-40c4-8476-20771a674376 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:14.826998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7005ae-5659-40c4-8476-20771a674376 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:14.827271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7005ae-5659-40c4-8476-20771a674376 None admin] PATH_INFO: `/v3/projects/7168523196e54bcd9d69140af3ff0c58` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:14.828517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7005ae-5659-40c4-8476-20771a674376 None admin] RBAC: Authorizing `identity:get_project(project_id=7168523196e54bcd9d69140af3ff0c58)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:14.829963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7005ae-5659-40c4-8476-20771a674376 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:14.831668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 561/1145] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:14 2022] GET /identity/v3/projects/7168523196e54bcd9d69140af3ff0c58 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:14.839022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:14.946446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a48290-2883-4282-aa22-a338a5579b35 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:14.980738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af8aa-ccf9-45e6-8982-8b6f7ceb3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:14.981406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af8aa-ccf9-45e6-8982-8b6f7ceb3f66 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:14.981689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af8aa-ccf9-45e6-8982-8b6f7ceb3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:14.981967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af8aa-ccf9-45e6-8982-8b6f7ceb3f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:14.982787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af8aa-ccf9-45e6-8982-8b6f7ceb3f66 None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=7168523196e54bcd9d69140af3ff0c58, user.id=eaa59ec288a84e66b5fb6a2322edbaa2) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:14.983099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af8aa-ccf9-45e6-8982-8b6f7ceb3f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:14.984561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af8aa-ccf9-45e6-8982-8b6f7ceb3f66 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:14.990136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 585/1146] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:42:14 2022] GET /identity/v3/role_assignments?user.id=eaa59ec288a84e66b5fb6a2322edbaa2&scope.project.id=7168523196e54bcd9d69140af3ff0c58&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:17.163034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6118-7854-4705-96e8-6eb212932037 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:17.163943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6118-7854-4705-96e8-6eb212932037 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:17.163943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff6118-7854-4705-96e8-6eb212932037 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:17.166188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 562/1147] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:17.172409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857aaa-81c4-4632-8243-ea8e5c9bacdb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:17.172837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857aaa-81c4-4632-8243-ea8e5c9bacdb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:17.173022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857aaa-81c4-4632-8243-ea8e5c9bacdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:17.191510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-11857aaa-81c4-4632-8243-ea8e5c9bacdb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:17.193108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-11857aaa-81c4-4632-8243-ea8e5c9bacdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:17.262226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 586/1148] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:17.288690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6118-7854-4705-96e8-6eb212932037 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:17.398844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff6118-7854-4705-96e8-6eb212932037 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:17.433219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:17.433932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:17.434214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:17.434489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:17.445019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:42:17.452548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:42:17.453632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:42:17.454659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 563/1149] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:42:17.460164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857aaa-81c4-4632-8243-ea8e5c9bacdb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:17.570751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857aaa-81c4-4632-8243-ea8e5c9bacdb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:17.604901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:17.605553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:17.605829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:17.606097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:17.606837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:17.607158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:17.608566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:17.616536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 587/1150] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:17.625833 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:17.732631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574abd-69c6-422e-93c8-d057ac88b4cc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:17.766745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:17.767601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:17.767914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:17.768193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] PATH_INFO: `/v3/users/eaa59ec288a84e66b5fb6a2322edbaa2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:17.769506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] RBAC: Authorizing `identity:get_user(user_id=eaa59ec288a84e66b5fb6a2322edbaa2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:17.771020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:17.772684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 564/1151] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:17 2022] GET /identity/v3/users/eaa59ec288a84e66b5fb6a2322edbaa2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:17.778651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:17.890812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986afc6-7924-4bd6-a6d1-2ceccf192a6d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:17.926195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db58e17-69eb-4a3e-bdf9-6c2f81ce3adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:17.927193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58e17-69eb-4a3e-bdf9-6c2f81ce3adb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:17.927481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58e17-69eb-4a3e-bdf9-6c2f81ce3adb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:17.927763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58e17-69eb-4a3e-bdf9-6c2f81ce3adb None admin] PATH_INFO: `/v3/projects/7168523196e54bcd9d69140af3ff0c58` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:17.929017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db58e17-69eb-4a3e-bdf9-6c2f81ce3adb None admin] RBAC: Authorizing `identity:get_project(project_id=7168523196e54bcd9d69140af3ff0c58)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:17.930457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db58e17-69eb-4a3e-bdf9-6c2f81ce3adb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:17.932185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 588/1152] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:17 2022] GET /identity/v3/projects/7168523196e54bcd9d69140af3ff0c58 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:17.938091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:18.046221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29817045-0045-49e0-8f75-c1d74ef6dc6b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:18.079532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82a157-f5e5-48f9-abd6-d641fad75083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:18.080441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82a157-f5e5-48f9-abd6-d641fad75083 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:18.080715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82a157-f5e5-48f9-abd6-d641fad75083 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:18.080988 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82a157-f5e5-48f9-abd6-d641fad75083 None admin] PATH_INFO: `/v3/projects/7168523196e54bcd9d69140af3ff0c58/users/eaa59ec288a84e66b5fb6a2322edbaa2/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:18.083239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82a157-f5e5-48f9-abd6-d641fad75083 None admin] RBAC: Authorizing `identity:create_grant(project_id=7168523196e54bcd9d69140af3ff0c58, user_id=eaa59ec288a84e66b5fb6a2322edbaa2, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:18.084702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82a157-f5e5-48f9-abd6-d641fad75083 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:18.102231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 565/1153] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:42:17 2022] PUT /identity/v3/projects/7168523196e54bcd9d69140af3ff0c58/users/eaa59ec288a84e66b5fb6a2322edbaa2/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:42:20.282798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412beb-5f6b-4ed8-acc1-88c2fdcc49b0 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:20.283727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412beb-5f6b-4ed8-acc1-88c2fdcc49b0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:20.283727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412beb-5f6b-4ed8-acc1-88c2fdcc49b0 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:20.285876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 589/1154] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:20.291378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57301eff-bcea-4ad3-a688-4d9210a62cfd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:20.291793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57301eff-bcea-4ad3-a688-4d9210a62cfd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:20.291971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57301eff-bcea-4ad3-a688-4d9210a62cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:20.310010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-57301eff-bcea-4ad3-a688-4d9210a62cfd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:20.311199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-57301eff-bcea-4ad3-a688-4d9210a62cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:20.387303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 566/1155] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:20.421571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af412beb-5f6b-4ed8-acc1-88c2fdcc49b0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:20.545494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af412beb-5f6b-4ed8-acc1-88c2fdcc49b0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:20.581234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:20.582025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:20.582312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:20.582607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:20.595568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:42:20.603190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:42:20.604306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:42:20.609002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 590/1156] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:42:20.610568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57301eff-bcea-4ad3-a688-4d9210a62cfd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:20.722477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57301eff-bcea-4ad3-a688-4d9210a62cfd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:20.757232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:20.757896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:20.758182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:20.758455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:20.759238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:20.759551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:20.760967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:20.768872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 567/1157] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:20.777354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:20.894338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe461a-044e-45e3-8ffe-ba8ba3fd150a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:20.933166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:20.934041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:20.934287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:20.934592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] PATH_INFO: `/v3/users/eaa59ec288a84e66b5fb6a2322edbaa2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:20.935977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] RBAC: Authorizing `identity:get_user(user_id=eaa59ec288a84e66b5fb6a2322edbaa2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:20.937338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:20.938978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 591/1158] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:20 2022] GET /identity/v3/users/eaa59ec288a84e66b5fb6a2322edbaa2 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:20.946300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:21.058823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132434a-2849-4fe0-b644-cfc8738d08bd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:21.093495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:21.094134 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:21.094393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:21.094701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:21.163400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:21.164545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:21.266105 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 568/1159] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:42:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:42:21.272855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:21.371975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e298d07-9319-4d1c-89ef-a0efb208e97a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:21.406499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682e870-feb0-4dfa-9567-031fe4c03442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:21.407375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e870-feb0-4dfa-9567-031fe4c03442 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:21.407659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e870-feb0-4dfa-9567-031fe4c03442 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:21.407969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e870-feb0-4dfa-9567-031fe4c03442 None admin] PATH_INFO: `/v3/projects/7168523196e54bcd9d69140af3ff0c58` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:21.409380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682e870-feb0-4dfa-9567-031fe4c03442 None admin] RBAC: Authorizing `identity:get_project(project_id=7168523196e54bcd9d69140af3ff0c58)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:21.411386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682e870-feb0-4dfa-9567-031fe4c03442 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:21.413184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 592/1160] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:21 2022] GET /identity/v3/projects/7168523196e54bcd9d69140af3ff0c58 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:21.422498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:21.527739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ad54-e75b-4925-929e-f967057dfd00 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:21.562859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400a563-44ee-4192-bdf7-4ce26d82bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:21.563507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a563-44ee-4192-bdf7-4ce26d82bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:21.563787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a563-44ee-4192-bdf7-4ce26d82bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:21.564099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a563-44ee-4192-bdf7-4ce26d82bdfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:21.564930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400a563-44ee-4192-bdf7-4ce26d82bdfa None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=7168523196e54bcd9d69140af3ff0c58, user.id=eaa59ec288a84e66b5fb6a2322edbaa2) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:21.565241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400a563-44ee-4192-bdf7-4ce26d82bdfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:21.566704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400a563-44ee-4192-bdf7-4ce26d82bdfa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:21.572767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 569/1161] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:42:21 2022] GET /identity/v3/role_assignments?user.id=eaa59ec288a84e66b5fb6a2322edbaa2&scope.project.id=7168523196e54bcd9d69140af3ff0c58&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:23.793580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d112ef-ad21-4e6d-b465-6023f7d47613 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:23.794393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d112ef-ad21-4e6d-b465-6023f7d47613 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:23.794393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d112ef-ad21-4e6d-b465-6023f7d47613 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:23.796601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 593/1162] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:23.802434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1132-0724-4860-8a87-094856fff8dc None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:23.802849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1132-0724-4860-8a87-094856fff8dc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:23.802936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1132-0724-4860-8a87-094856fff8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:23.824596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f22b1132-0724-4860-8a87-094856fff8dc None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:23.826431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f22b1132-0724-4860-8a87-094856fff8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:23.912939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 570/1163] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:23.935551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d112ef-ad21-4e6d-b465-6023f7d47613 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:24.044662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d112ef-ad21-4e6d-b465-6023f7d47613 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:24.082391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:24.083032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:24.083319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:24.083595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:24.155090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:24.156583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:24.256017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 594/1164] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:42:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:42:24.265644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1132-0724-4860-8a87-094856fff8dc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:24.368353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1132-0724-4860-8a87-094856fff8dc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:24.415719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532978ee-f79a-4113-bd24-4ce69cca93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:24.416548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532978ee-f79a-4113-bd24-4ce69cca93ee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:24.416824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532978ee-f79a-4113-bd24-4ce69cca93ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:24.417136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532978ee-f79a-4113-bd24-4ce69cca93ee None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:24.424204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532978ee-f79a-4113-bd24-4ce69cca93ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:24.425662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532978ee-f79a-4113-bd24-4ce69cca93ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-532978ee-f79a-4113-bd24-4ce69cca93ee None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:42:24.439780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:42:24.441000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 14:42:24.442233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:42:24.444055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 571/1165] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:42:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:42:24.447494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:24.558656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863a00-5a02-487e-9b54-4af62d469351 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:24.595633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c9ef1-e195-4f21-b4e2-84b496f4f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:24.596324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9ef1-e195-4f21-b4e2-84b496f4f514 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:24.596607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9ef1-e195-4f21-b4e2-84b496f4f514 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:24.596885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9ef1-e195-4f21-b4e2-84b496f4f514 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:24.597619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9ef1-e195-4f21-b4e2-84b496f4f514 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:24.598110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9ef1-e195-4f21-b4e2-84b496f4f514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:24.599622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9ef1-e195-4f21-b4e2-84b496f4f514 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:24.606874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 595/1166] 10.222.0.99 () {56 vars in 1115 bytes} [Fri May 13 14:42:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:26.769855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48dd6-3457-4bd8-8e7c-fff2f21d7860 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:26.770745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48dd6-3457-4bd8-8e7c-fff2f21d7860 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:26.770745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48dd6-3457-4bd8-8e7c-fff2f21d7860 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:26.772181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 572/1167] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:26.777724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e035a-033e-47ee-8e64-ed8b7c2785b6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:26.778164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e035a-033e-47ee-8e64-ed8b7c2785b6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:26.778261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e035a-033e-47ee-8e64-ed8b7c2785b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:26.796579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b80e035a-033e-47ee-8e64-ed8b7c2785b6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:26.797745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b80e035a-033e-47ee-8e64-ed8b7c2785b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:26.863684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 596/1168] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:26.887530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48dd6-3457-4bd8-8e7c-fff2f21d7860 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:26.991181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48dd6-3457-4bd8-8e7c-fff2f21d7860 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:27.024540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a1fc7-40f6-4caa-98b7-a0e3764a73ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:27.025118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a1fc7-40f6-4caa-98b7-a0e3764a73ba None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:27.025388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a1fc7-40f6-4caa-98b7-a0e3764a73ba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:27.025659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a1fc7-40f6-4caa-98b7-a0e3764a73ba None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:27.026379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a1fc7-40f6-4caa-98b7-a0e3764a73ba None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:27.027759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a1fc7-40f6-4caa-98b7-a0e3764a73ba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:27.046594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 573/1169] 10.222.0.99 () {60 vars in 1138 bytes} [Fri May 13 14:42:26 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:42:29.253285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7f60-ef29-4da3-b03f-26db651f6e4f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:29.254379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7f60-ef29-4da3-b03f-26db651f6e4f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:29.254379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7f60-ef29-4da3-b03f-26db651f6e4f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:29.256439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 597/1170] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:29.262747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73c70d-eca1-4670-9e89-8aa9b24f69dc None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:29.263194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73c70d-eca1-4670-9e89-8aa9b24f69dc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:29.263325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73c70d-eca1-4670-9e89-8aa9b24f69dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:29.284801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4f73c70d-eca1-4670-9e89-8aa9b24f69dc None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:29.286254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4f73c70d-eca1-4670-9e89-8aa9b24f69dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:29.357558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 574/1171] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:29.381248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d7f60-ef29-4da3-b03f-26db651f6e4f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:29.489107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d7f60-ef29-4da3-b03f-26db651f6e4f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:29.528797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e78576-3ee3-47e8-b6e6-b15a5484aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:29.530184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e78576-3ee3-47e8-b6e6-b15a5484aa5f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:29.530566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e78576-3ee3-47e8-b6e6-b15a5484aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:29.530941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e78576-3ee3-47e8-b6e6-b15a5484aa5f None admin] PATH_INFO: `/v3/domains/1d9ef47039d44a0490b2009e5c0707bb` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:29.543682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e78576-3ee3-47e8-b6e6-b15a5484aa5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=1d9ef47039d44a0490b2009e5c0707bb)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:29.545236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e78576-3ee3-47e8-b6e6-b15a5484aa5f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:29.546886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 598/1172] 10.222.0.99 () {56 vars in 1183 bytes} [Fri May 13 14:42:29 2022] GET /identity/v3/domains/1d9ef47039d44a0490b2009e5c0707bb => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:29.552906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73c70d-eca1-4670-9e89-8aa9b24f69dc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:29.653144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73c70d-eca1-4670-9e89-8aa9b24f69dc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:29.690397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c5f50-3e57-410c-b733-4f631af81349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:29.691234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5f50-3e57-410c-b733-4f631af81349 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:29.691489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5f50-3e57-410c-b733-4f631af81349 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:29.691793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5f50-3e57-410c-b733-4f631af81349 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:29.692527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c5f50-3e57-410c-b733-4f631af81349 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:29.693980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c5f50-3e57-410c-b733-4f631af81349 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:29.723492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 575/1173] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:42:29 2022] POST /identity/v3/projects => generated 361 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:42:31.951055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd0dd-6474-4869-8aa0-35af83de464f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:31.951909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd0dd-6474-4869-8aa0-35af83de464f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:31.951909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd0dd-6474-4869-8aa0-35af83de464f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:31.954053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 599/1174] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:31.959901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc44a-5930-4681-bad2-d81e9ac6a8c0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:31.960333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc44a-5930-4681-bad2-d81e9ac6a8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:31.960431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc44a-5930-4681-bad2-d81e9ac6a8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:31.979304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-080dc44a-5930-4681-bad2-d81e9ac6a8c0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:31.980525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-080dc44a-5930-4681-bad2-d81e9ac6a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:32.052672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 576/1175] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:32.089029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fd0dd-6474-4869-8aa0-35af83de464f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:32.193918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fd0dd-6474-4869-8aa0-35af83de464f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:32.227270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd6d18-a897-4671-80dd-10a371c49d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:32.228149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd6d18-a897-4671-80dd-10a371c49d9b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:32.228430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd6d18-a897-4671-80dd-10a371c49d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:32.228703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd6d18-a897-4671-80dd-10a371c49d9b None admin] PATH_INFO: `/v3/domains/1d9ef47039d44a0490b2009e5c0707bb` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:32.229981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd6d18-a897-4671-80dd-10a371c49d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=1d9ef47039d44a0490b2009e5c0707bb)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:32.231425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd6d18-a897-4671-80dd-10a371c49d9b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:32.233123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 600/1176] 10.222.0.99 () {56 vars in 1183 bytes} [Fri May 13 14:42:32 2022] GET /identity/v3/domains/1d9ef47039d44a0490b2009e5c0707bb => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:32.239655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dc44a-5930-4681-bad2-d81e9ac6a8c0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:32.355022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dc44a-5930-4681-bad2-d81e9ac6a8c0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:32.394085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39a68d-e54e-4d10-86c6-0babf5905c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:32.394814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a68d-e54e-4d10-86c6-0babf5905c83 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:32.395099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a68d-e54e-4d10-86c6-0babf5905c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:32.395378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a68d-e54e-4d10-86c6-0babf5905c83 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:32.396115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39a68d-e54e-4d10-86c6-0babf5905c83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:32.397569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39a68d-e54e-4d10-86c6-0babf5905c83 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:32.422750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 577/1177] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:42:32 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:42:34.677243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af400-2e23-4754-8f23-15c137f92a53 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:34.677807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af400-2e23-4754-8f23-15c137f92a53 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:34.677807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af400-2e23-4754-8f23-15c137f92a53 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:34.679955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 601/1178] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:34.688881 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ed9d0-5edf-47bc-b21a-ee162cb612c8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:34.689288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ed9d0-5edf-47bc-b21a-ee162cb612c8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:34.689486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ed9d0-5edf-47bc-b21a-ee162cb612c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:34.707768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9e2ed9d0-5edf-47bc-b21a-ee162cb612c8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:34.708969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9e2ed9d0-5edf-47bc-b21a-ee162cb612c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:34.785653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 578/1179] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:34.817446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af400-2e23-4754-8f23-15c137f92a53 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:34.918790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af400-2e23-4754-8f23-15c137f92a53 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:34.951645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:34.952456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:34.952731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:34.953003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:34.963695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:42:34.971430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:42:34.972548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:42:34.973555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 602/1180] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:42:34.981622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ed9d0-5edf-47bc-b21a-ee162cb612c8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:35.090384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ed9d0-5edf-47bc-b21a-ee162cb612c8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:35.128663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:35.129327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:35.129614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:35.129888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:35.130641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:35.130948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:35.132373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:35.140716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 579/1181] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:35.147520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:35.270735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9d4c-a65b-4fd1-97c0-4dfa70e404bf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:35.306277 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:35.307144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:35.307423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:35.307693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] PATH_INFO: `/v3/users/cc19102962364f28af4f4c0c7a1c811e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:35.320734 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] RBAC: Authorizing `identity:get_user(user_id=cc19102962364f28af4f4c0c7a1c811e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:35.322162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:35.323813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 603/1182] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:35 2022] GET /identity/v3/users/cc19102962364f28af4f4c0c7a1c811e => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:35.330072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:35.427317 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c1c65-fd76-4c6b-bc46-96eb1644526d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:35.461577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:35.462220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:35.462496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:35.462779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:35.532583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:35.534182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:35.634146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 580/1183] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:42:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:42:35.640511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:35.741871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff93052-88ae-4f5a-aa19-669a16b07af1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:35.775305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2ea8a-8b42-4246-8b58-f997a5868c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:35.776171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2ea8a-8b42-4246-8b58-f997a5868c49 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:35.776443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2ea8a-8b42-4246-8b58-f997a5868c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:35.776709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2ea8a-8b42-4246-8b58-f997a5868c49 None admin] PATH_INFO: `/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:35.777995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2ea8a-8b42-4246-8b58-f997a5868c49 None admin] RBAC: Authorizing `identity:get_project(project_id=de01fd6f6bf446a1b3b14f9788a3fd15)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:35.779414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2ea8a-8b42-4246-8b58-f997a5868c49 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:35.781124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 604/1184] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:35 2022] GET /identity/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:35.787857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:35.903218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53114-fac1-4522-b6ed-5c4f92192d94 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:35.938562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68e4c-d6b3-4be9-8623-03000afb5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:35.939210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68e4c-d6b3-4be9-8623-03000afb5adf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:35.939493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68e4c-d6b3-4be9-8623-03000afb5adf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:35.939767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68e4c-d6b3-4be9-8623-03000afb5adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:35.941132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68e4c-d6b3-4be9-8623-03000afb5adf None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=de01fd6f6bf446a1b3b14f9788a3fd15, user.id=cc19102962364f28af4f4c0c7a1c811e) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:35.941448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68e4c-d6b3-4be9-8623-03000afb5adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:35.942919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68e4c-d6b3-4be9-8623-03000afb5adf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:35.948456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 581/1185] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:42:35 2022] GET /identity/v3/role_assignments?user.id=cc19102962364f28af4f4c0c7a1c811e&scope.project.id=de01fd6f6bf446a1b3b14f9788a3fd15&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:38.119643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff7ba-4d86-4f2f-ae37-19fe666d4e55 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:38.120623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff7ba-4d86-4f2f-ae37-19fe666d4e55 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:38.120623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ff7ba-4d86-4f2f-ae37-19fe666d4e55 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:38.122713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 605/1186] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:38.128474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5daf8-371c-45a4-9196-90e3f7e229f0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:38.128908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5daf8-371c-45a4-9196-90e3f7e229f0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:38.129005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5daf8-371c-45a4-9196-90e3f7e229f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:38.147751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-88e5daf8-371c-45a4-9196-90e3f7e229f0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:38.148950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-88e5daf8-371c-45a4-9196-90e3f7e229f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:38.217860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 582/1187] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:38.240969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ff7ba-4d86-4f2f-ae37-19fe666d4e55 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:38.366389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ff7ba-4d86-4f2f-ae37-19fe666d4e55 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:38.400701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:38.401451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:38.401730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:38.402004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:38.412631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:42:38.420165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:42:38.421214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:42:38.422418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 606/1188] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:42:38.430598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5daf8-371c-45a4-9196-90e3f7e229f0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:38.545002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5daf8-371c-45a4-9196-90e3f7e229f0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:38.581089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:38.581758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:38.582037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:38.582310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:38.583051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:38.583352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:38.584752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:38.593758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 583/1189] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:38.601774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:38.710293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286c19-36ce-47a1-a69a-bf5ba78d3a80 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:38.744118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:38.744981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:38.745268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:38.745543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] PATH_INFO: `/v3/users/cc19102962364f28af4f4c0c7a1c811e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:38.746842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cc19102962364f28af4f4c0c7a1c811e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:38.748325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:38.749950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 607/1190] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:38 2022] GET /identity/v3/users/cc19102962364f28af4f4c0c7a1c811e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:38.756204 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:38.855609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8701322-6bf7-462d-8a37-00f02fea6b3b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:38.889322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651f428-2ca6-4696-a66f-97bcb76cddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:38.890280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651f428-2ca6-4696-a66f-97bcb76cddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:38.890556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651f428-2ca6-4696-a66f-97bcb76cddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:38.890825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651f428-2ca6-4696-a66f-97bcb76cddc7 None admin] PATH_INFO: `/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:38.892193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651f428-2ca6-4696-a66f-97bcb76cddc7 None admin] RBAC: Authorizing `identity:get_project(project_id=de01fd6f6bf446a1b3b14f9788a3fd15)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:38.893729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651f428-2ca6-4696-a66f-97bcb76cddc7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:38.895577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 584/1191] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:38 2022] GET /identity/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:38.904824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:39.009892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef089-8e74-4d40-8c1c-9719228855c8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:39.043098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35bcba-8bb3-42d5-a3ed-d9fdebfab9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:39.044042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35bcba-8bb3-42d5-a3ed-d9fdebfab9df None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:39.044315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35bcba-8bb3-42d5-a3ed-d9fdebfab9df None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:39.044586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35bcba-8bb3-42d5-a3ed-d9fdebfab9df None admin] PATH_INFO: `/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15/users/cc19102962364f28af4f4c0c7a1c811e/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:39.046761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35bcba-8bb3-42d5-a3ed-d9fdebfab9df None admin] RBAC: Authorizing `identity:create_grant(project_id=de01fd6f6bf446a1b3b14f9788a3fd15, user_id=cc19102962364f28af4f4c0c7a1c811e, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:39.048204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35bcba-8bb3-42d5-a3ed-d9fdebfab9df None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:39.064291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 608/1192] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:42:38 2022] PUT /identity/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15/users/cc19102962364f28af4f4c0c7a1c811e/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:42:41.259148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b126-acfe-43dd-a631-4e6a8010117a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:41.259992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b126-acfe-43dd-a631-4e6a8010117a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:41.259992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b126-acfe-43dd-a631-4e6a8010117a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:41.262159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 585/1193] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:42:41.267828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed474f1d-46a3-4f12-9365-9cdd90f415b6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:41.268282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed474f1d-46a3-4f12-9365-9cdd90f415b6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:41.268588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed474f1d-46a3-4f12-9365-9cdd90f415b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:41.286982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ed474f1d-46a3-4f12-9365-9cdd90f415b6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:42:41.288187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ed474f1d-46a3-4f12-9365-9cdd90f415b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:42:41.358051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 609/1194] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:42:41.381273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b126-acfe-43dd-a631-4e6a8010117a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:41.488340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b126-acfe-43dd-a631-4e6a8010117a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:41.525732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:41.526957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:41.527400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:41.527836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:41.542131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:42:41.549598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:42:41.550619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:42:41.551704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 586/1195] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:42:41.557792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed474f1d-46a3-4f12-9365-9cdd90f415b6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:41.662908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed474f1d-46a3-4f12-9365-9cdd90f415b6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:41.699399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:41.700092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:41.700378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:41.700649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:41.701393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:41.701700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:41.703076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:41.711628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 610/1196] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:41.721315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:41.833948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e966c-13e1-47c2-ba75-20eee63acfd0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:41.868373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:41.869221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:41.869497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:41.869776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] PATH_INFO: `/v3/users/cc19102962364f28af4f4c0c7a1c811e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:41.871065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] RBAC: Authorizing `identity:get_user(user_id=cc19102962364f28af4f4c0c7a1c811e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:41.872565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:41.874197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 587/1197] 10.222.0.99 () {56 vars in 1177 bytes} [Fri May 13 14:42:41 2022] GET /identity/v3/users/cc19102962364f28af4f4c0c7a1c811e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:41.881103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:41.984723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe80b8-3d84-4e36-a97c-d96270d10839 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:42.022719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:42.023357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:42.023641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:42.023918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:42.096731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:42.098114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:42.193590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 611/1198] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:42:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:42:42.203079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:42.310252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a8ff-c2ed-46f0-967a-ee1d042cfafb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:42.344094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae6505-ff8c-45bb-8c5d-76d261435596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:42.344942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae6505-ff8c-45bb-8c5d-76d261435596 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:42.345214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae6505-ff8c-45bb-8c5d-76d261435596 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:42.345478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae6505-ff8c-45bb-8c5d-76d261435596 None admin] PATH_INFO: `/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:42.346856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae6505-ff8c-45bb-8c5d-76d261435596 None admin] RBAC: Authorizing `identity:get_project(project_id=de01fd6f6bf446a1b3b14f9788a3fd15)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:42.348255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae6505-ff8c-45bb-8c5d-76d261435596 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:42.349937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 588/1199] 10.222.0.99 () {56 vars in 1186 bytes} [Fri May 13 14:42:42 2022] GET /identity/v3/projects/de01fd6f6bf446a1b3b14f9788a3fd15 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:42:42.356784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:42:42.463105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bf98-89bb-43f1-b347-2c3c1dc9f2b5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:42:42.499268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15712340-e5a4-413b-8e43-5a5979b77f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:42:42.499945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712340-e5a4-413b-8e43-5a5979b77f5c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:42:42.500224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712340-e5a4-413b-8e43-5a5979b77f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:42:42.500493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712340-e5a4-413b-8e43-5a5979b77f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:42:42.501313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15712340-e5a4-413b-8e43-5a5979b77f5c None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=de01fd6f6bf446a1b3b14f9788a3fd15, user.id=cc19102962364f28af4f4c0c7a1c811e) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:42:42.501620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15712340-e5a4-413b-8e43-5a5979b77f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:42:42.503113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15712340-e5a4-413b-8e43-5a5979b77f5c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:42:42.508757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 612/1200] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:42:42 2022] GET /identity/v3/role_assignments?user.id=cc19102962364f28af4f4c0c7a1c811e&scope.project.id=de01fd6f6bf446a1b3b14f9788a3fd15&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:43.017861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0428db-c8ed-46a4-8f24-6f4e2c24a56d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:43.018507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0428db-c8ed-46a4-8f24-6f4e2c24a56d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:43.018507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0428db-c8ed-46a4-8f24-6f4e2c24a56d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:43.019786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 589/1201] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:43:43.026265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d75d-e247-44d7-bfe1-2cb2fe73f256 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:43.026789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d75d-e247-44d7-bfe1-2cb2fe73f256 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:43.026874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d75d-e247-44d7-bfe1-2cb2fe73f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:43.046093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b121d75d-e247-44d7-bfe1-2cb2fe73f256 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:43:43.047297 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b121d75d-e247-44d7-bfe1-2cb2fe73f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:43:43.132653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 613/1202] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:43:43.159395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0428db-c8ed-46a4-8f24-6f4e2c24a56d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:43.281737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0428db-c8ed-46a4-8f24-6f4e2c24a56d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:43.320942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:43.321907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:43.322207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:43.322521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:43.335704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:43.337746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:43:43.359068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:43.365958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:43.366995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:43:43.366995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:43:43.366995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:43.366995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:43:43.366995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 590/1203] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:43.370573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d75d-e247-44d7-bfe1-2cb2fe73f256 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:43.497958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d75d-e247-44d7-bfe1-2cb2fe73f256 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:43.535040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc5bf7-1eb4-4453-b2c6-68fedbbdf8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:43.535645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5bf7-1eb4-4453-b2c6-68fedbbdf8ea None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:43.536028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5bf7-1eb4-4453-b2c6-68fedbbdf8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:43.536971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5bf7-1eb4-4453-b2c6-68fedbbdf8ea None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:43.537155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc5bf7-1eb4-4453-b2c6-68fedbbdf8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:43.537463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc5bf7-1eb4-4453-b2c6-68fedbbdf8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:43.538876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc5bf7-1eb4-4453-b2c6-68fedbbdf8ea None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:43.551814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 614/1204] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:43.557412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:43.677293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9026-e499-4138-99f8-105ae04afff7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:43.720412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3e20a-dc66-4dc7-870b-e7fbef46aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:43.721101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3e20a-dc66-4dc7-870b-e7fbef46aa58 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:43.721414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3e20a-dc66-4dc7-870b-e7fbef46aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:43.721688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3e20a-dc66-4dc7-870b-e7fbef46aa58 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:43.722406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3e20a-dc66-4dc7-870b-e7fbef46aa58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:43.723884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3e20a-dc66-4dc7-870b-e7fbef46aa58 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:43.745583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 591/1205] 10.222.0.99 () {60 vars in 1132 bytes} [Fri May 13 14:43:43 2022] POST /identity/v3/users => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:43:46.313093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5ea5-6e48-4400-96f6-ffe3a354f97e None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:46.314918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5ea5-6e48-4400-96f6-ffe3a354f97e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:46.314918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5ea5-6e48-4400-96f6-ffe3a354f97e None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:46.315131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 615/1206] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:43:46.320932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374e7c-efc2-47e4-a8cc-5fea06280cd2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:46.321386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374e7c-efc2-47e4-a8cc-5fea06280cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:46.323778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374e7c-efc2-47e4-a8cc-5fea06280cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:46.345144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-12374e7c-efc2-47e4-a8cc-5fea06280cd2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:43:46.346348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-12374e7c-efc2-47e4-a8cc-5fea06280cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:43:46.421368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 592/1207] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:43:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:43:46.445029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f5ea5-6e48-4400-96f6-ffe3a354f97e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:46.570402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f5ea5-6e48-4400-96f6-ffe3a354f97e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:46.609410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:46.610217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:46.610540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:46.610774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:46.623860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:43:46.632936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:46.634159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:46.635123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 616/1208] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:46.641563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374e7c-efc2-47e4-a8cc-5fea06280cd2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:46.757189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374e7c-efc2-47e4-a8cc-5fea06280cd2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:46.797327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:46.798190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:46.798535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:46.798816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:46.799727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:46.800116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:46.801726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:46.810816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 593/1209] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:46.816571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:46.932204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f905345-d6ce-4235-b360-d7f9af831ea9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:46.971447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:46.972495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:46.972924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:46.973212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:46.985352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:46.987185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:43:47.006007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:47.007278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:47.008412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:43:47.008412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:43:47.008412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:47.008412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:47.010039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 617/1210] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:43:47.016442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:47.127373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0769313-dfa6-4b40-b227-095786dde2d5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:47.166192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:47.166985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:47.167272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:47.170878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:47.170878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:47.170878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:47.170878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:47.184902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 594/1211] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:43:47.190167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:47.303628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ad36-7faa-4619-8fa3-ac281da5ded8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:47.343954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:47.345840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:47.345840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:47.345840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:47.354440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:47.356056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:43:47.372558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:47.373665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:47.380020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 618/1212] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:47.380667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:47.497438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db459b7-b61a-4d24-b592-b26704753063 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:47.538192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:47.538937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:47.539304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:47.539625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:47.540574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:47.540893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:47.542593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:47.562051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 595/1213] 10.222.0.99 () {56 vars in 1143 bytes} [Fri May 13 14:43:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:47.568336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:47.682099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b8d9-06a9-4f8d-aaa8-ab3dacc6adff None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:47.718741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:47.719477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:47.719765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:47.720077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:47.799238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:47.800762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:47.915289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 619/1214] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:43:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:43:47.921633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:48.032921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b676b00-b452-4cdb-9125-bd52ce5aa5c6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:48.076107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:48.076955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:48.077360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:48.077721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:48.089576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:48.091466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:43:48.109490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:48.110715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:48.113491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:43:48.113491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:43:48.113491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:48.113491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:43:48.113491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 596/1215] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:48.117994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:48.228809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c01eb5-fc4d-4fa7-b6ac-fe15eb4ea09c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:48.263936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:48.264626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:48.264910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:48.265183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:48.265925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:48.266240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:48.267723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:48.279840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 620/1216] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:48.286453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:48.409803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972f23c-2d1e-4e46-aaa1-b8c958b23caa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:48.445849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:48.448430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:48.448767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:48.449100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:48.456046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:48.457559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:43:48.472599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:48.473776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:43:48.474735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 597/1217] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:48.480265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:48.589101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad156e2-824a-498a-ba01-50dc1ea48379 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:48.622906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5b05f-6d5e-48ef-b9f4-278ab6f5931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:48.623733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b05f-6d5e-48ef-b9f4-278ab6f5931c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:48.624140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b05f-6d5e-48ef-b9f4-278ab6f5931c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:48.624507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b05f-6d5e-48ef-b9f4-278ab6f5931c None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:48.625407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5b05f-6d5e-48ef-b9f4-278ab6f5931c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:48.625864 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5b05f-6d5e-48ef-b9f4-278ab6f5931c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:48.627642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5b05f-6d5e-48ef-b9f4-278ab6f5931c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:48.642223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 621/1218] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:43:48.648260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:48.766493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dccd0-eaf9-422d-99dc-4ba524b6e209 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:48.803272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8ad9-380b-40e6-8b64-e1c0944e4fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:48.803962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8ad9-380b-40e6-8b64-e1c0944e4fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:48.804287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8ad9-380b-40e6-8b64-e1c0944e4fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:48.804521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8ad9-380b-40e6-8b64-e1c0944e4fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:48.805378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8ad9-380b-40e6-8b64-e1c0944e4fd3 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=f3b12b26b87d438c8f4eb61c8a93b31d) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:48.805691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8ad9-380b-40e6-8b64-e1c0944e4fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:48.807168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8ad9-380b-40e6-8b64-e1c0944e4fd3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:48.814752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 598/1219] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:43:48 2022] GET /identity/v3/role_assignments?user.id=f3b12b26b87d438c8f4eb61c8a93b31d&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:51.373327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db300-fc18-4849-9f82-f65fc3ad7c5e None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:51.373926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db300-fc18-4849-9f82-f65fc3ad7c5e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:51.374186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db300-fc18-4849-9f82-f65fc3ad7c5e None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:51.375634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 622/1220] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:43:51.382068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48342-9df2-45b3-b662-95a3cd49c47a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:51.382594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48342-9df2-45b3-b662-95a3cd49c47a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:51.382594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48342-9df2-45b3-b662-95a3cd49c47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:51.400616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b9f48342-9df2-45b3-b662-95a3cd49c47a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:43:51.402241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b9f48342-9df2-45b3-b662-95a3cd49c47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:43:51.482818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 599/1221] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:43:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:43:51.506905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769db300-fc18-4849-9f82-f65fc3ad7c5e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:51.615347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769db300-fc18-4849-9f82-f65fc3ad7c5e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:51.648670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:51.649427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:51.649706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:51.649977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:51.660574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:43:51.668257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:51.669941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:51.671247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 623/1222] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:51.676603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48342-9df2-45b3-b662-95a3cd49c47a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:51.785910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48342-9df2-45b3-b662-95a3cd49c47a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:51.820019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:51.820751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:51.821026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:51.821303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:51.822111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:51.822417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:51.823951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:51.832490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 600/1223] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:51.838906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:51.956171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699b13b-7445-44e5-a0da-034097e22111 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:52.001884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:52.002684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:52.002968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:52.003271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:52.014507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:52.015991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:43:52.033642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:52.034733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:52.036231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:43:52.036231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:43:52.036231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:52.036231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:52.036231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 624/1224] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:52.041544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:52.146820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb2de7-7968-445e-934a-e2ec91d06859 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:52.183629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:52.184577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:52.184883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:52.185298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:52.185832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:52.186181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:52.187567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:52.201101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 601/1225] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:52.208667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:52.312414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62137e26-02aa-415a-8172-25abd29838d9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:52.349013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:52.349928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:52.350247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:52.350549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:52.358518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:52.359984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:43:52.385093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:52.387381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:52.388643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 625/1226] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:52.392893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:52.502353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3508-3379-4291-9636-166930219a0e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:52.542235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:52.543040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:52.543407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:52.543623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:52.544576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:52.544895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:52.546340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:52.566074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 602/1227] 10.222.0.99 () {56 vars in 1143 bytes} [Fri May 13 14:43:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:43:52.572264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:52.689204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ce24b-5df7-4d00-b81b-5d8614bae287 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:52.723924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:52.724832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:52.725133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:52.725393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:52.736684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:52.738158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:43:52.757493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:52.758598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:52.764885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:43:52.764885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:43:52.764885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:52.764885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:52.764885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 626/1228] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:52.765167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:52.882338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29260-9c36-47b7-b29f-78f7d6d87889 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:52.921455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:52.922118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:52.922401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:52.922670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:52.923394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:52.923696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:52.925122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:52.936883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 603/1229] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:43:52.942827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:53.050068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333f42-c9f8-47b1-9e7c-86fb911785c1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:53.091587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:53.092414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:53.092700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:53.092977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:53.099744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:53.101266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:43:53.116130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:53.117579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:53.118933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 627/1230] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:53.123935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:53.238585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4e46b-b5e8-4734-ba3f-e3b42784efe2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:53.274269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223001c-3ec0-444c-8e4b-979416ad7789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:53.275138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223001c-3ec0-444c-8e4b-979416ad7789 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:53.275419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223001c-3ec0-444c-8e4b-979416ad7789 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:53.275694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223001c-3ec0-444c-8e4b-979416ad7789 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:53.276810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223001c-3ec0-444c-8e4b-979416ad7789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:53.277341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223001c-3ec0-444c-8e4b-979416ad7789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:53.278788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223001c-3ec0-444c-8e4b-979416ad7789 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:53.292496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 604/1231] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:53.299169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:53.410542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10f391-ac9e-4b68-8d89-3c58c1b5d3e3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:53.449017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e6e77-3b3f-4c55-a9ae-fd9ece5d9345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:53.449968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6e77-3b3f-4c55-a9ae-fd9ece5d9345 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:53.450246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6e77-3b3f-4c55-a9ae-fd9ece5d9345 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:53.450521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6e77-3b3f-4c55-a9ae-fd9ece5d9345 None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/f3b12b26b87d438c8f4eb61c8a93b31d/roles/2a865ee865184972b66c89d62f6071fd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:53.465740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e6e77-3b3f-4c55-a9ae-fd9ece5d9345 None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=f3b12b26b87d438c8f4eb61c8a93b31d, role_id=2a865ee865184972b66c89d62f6071fd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:53.467191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e6e77-3b3f-4c55-a9ae-fd9ece5d9345 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:53.482099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 628/1232] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:43:53 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/f3b12b26b87d438c8f4eb61c8a93b31d/roles/2a865ee865184972b66c89d62f6071fd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:43:55.813482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87a884-b61c-4845-93de-a2469c0c17a8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:55.814041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87a884-b61c-4845-93de-a2469c0c17a8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:55.814041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87a884-b61c-4845-93de-a2469c0c17a8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:55.815316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 605/1233] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:43:55.820825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f688b-a90b-476b-9654-6ffddecbaec0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:55.821272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f688b-a90b-476b-9654-6ffddecbaec0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:55.821492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f688b-a90b-476b-9654-6ffddecbaec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:55.838979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cc9f688b-a90b-476b-9654-6ffddecbaec0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:43:55.840706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cc9f688b-a90b-476b-9654-6ffddecbaec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:43:55.931495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 629/1234] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:43:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:43:55.956583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87a884-b61c-4845-93de-a2469c0c17a8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:56.062779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87a884-b61c-4845-93de-a2469c0c17a8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:56.098339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:56.099060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:56.099344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:56.099623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:56.110763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:43:56.118564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:56.119701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:43:56.120890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 606/1235] 10.222.0.99 () {56 vars in 1102 bytes} [Fri May 13 14:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:56.126765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f688b-a90b-476b-9654-6ffddecbaec0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:56.232921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f688b-a90b-476b-9654-6ffddecbaec0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:56.267989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:56.268672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:56.268968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:56.269229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:56.269996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:56.270290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:56.271728 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:56.281190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 630/1236] 10.222.0.99 () {56 vars in 1103 bytes} [Fri May 13 14:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:56.287495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:56.399035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a283b8-f4d5-4cf0-bd14-189086c37b75 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:56.438463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:56.439277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:56.439558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:56.439838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:56.455001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:56.456558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:43:56.473854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:56.475005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:56.476016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:43:56.476016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:43:56.476016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:56.476016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:43:56.476016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 607/1237] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:56.481073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:56.586865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c290b5d-707a-4c01-a1c7-2485baec3d20 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:56.626280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:56.627043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:56.627339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:56.627612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:56.628381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:56.628683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:56.630059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:56.642158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 631/1238] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:56.647953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:56.768067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81481-b890-4dbd-8480-1c4f2376beb8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:56.809341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:56.810156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:56.810441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:56.810714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:56.818925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:56.820649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:43:56.836760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:56.838078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:43:56.839230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 608/1239] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:56.844043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:56.961296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157afe0-a987-4bd1-b2dc-b66b2a2b01e7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:57.000122 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156877-8751-476d-9723-747c2a605633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:57.001096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156877-8751-476d-9723-747c2a605633 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:57.001377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156877-8751-476d-9723-747c2a605633 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:57.001688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156877-8751-476d-9723-747c2a605633 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:57.002509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156877-8751-476d-9723-747c2a605633 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:57.002816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156877-8751-476d-9723-747c2a605633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:57.004317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156877-8751-476d-9723-747c2a605633 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:57.028923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 632/1240] 10.222.0.99 () {56 vars in 1143 bytes} [Fri May 13 14:43:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:57.033411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:57.142246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b312056-f770-442f-8ebc-1cc4fb3f82ab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:57.177019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:57.177676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:57.177960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:57.178232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:57.253650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:57.255131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:57.358910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 609/1241] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:43:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:43:57.364797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156877-8751-476d-9723-747c2a605633 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:57.465824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156877-8751-476d-9723-747c2a605633 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:57.503016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:57.503830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:57.504154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:57.504423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:57.516275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:57.517799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:43:57.537225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:57.538372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:57.539406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:43:57.539406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:43:57.539406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:43:57.539406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:57.539406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 633/1242] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:57.545018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:57.655410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cc0f8-423e-4998-8163-d8ec2ee196e5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:57.694039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:57.694717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:57.695257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:57.695382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:57.696077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:57.696387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:57.697810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:57.710282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 610/1243] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:43:57.716850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:57.821728 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4755fd-14d4-4ec9-92f5-14301e70a917 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:57.860744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:57.861583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:57.861859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:57.862155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:57.869958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:57.871649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:43:57.890539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:43:57.891765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:43:57.892885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:43:57.896017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 634/1244] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:43:57.899763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:58.013917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aac4ba-0d0a-4d56-ab6f-acd648e16c71 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:58.052070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1acd5-8513-482e-b927-b66a499e5015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:58.052779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1acd5-8513-482e-b927-b66a499e5015 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:58.053090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1acd5-8513-482e-b927-b66a499e5015 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:58.053468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1acd5-8513-482e-b927-b66a499e5015 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:58.054443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1acd5-8513-482e-b927-b66a499e5015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:58.054892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1acd5-8513-482e-b927-b66a499e5015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:58.056710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1acd5-8513-482e-b927-b66a499e5015 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:58.071969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 611/1245] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:43:58.079384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:43:58.203421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecaf52-3eab-46b2-b1e3-202d07912553 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:43:58.246177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2cecf-2c32-4eb8-9ee7-1e5df4117ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:43:58.246846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2cecf-2c32-4eb8-9ee7-1e5df4117ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:43:58.247124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2cecf-2c32-4eb8-9ee7-1e5df4117ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:43:58.247394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2cecf-2c32-4eb8-9ee7-1e5df4117ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:43:58.248277 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2cecf-2c32-4eb8-9ee7-1e5df4117ad7 None admin] RBAC: Adding query filter params (role.id=2a865ee865184972b66c89d62f6071fd, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=f3b12b26b87d438c8f4eb61c8a93b31d) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:43:58.248585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2cecf-2c32-4eb8-9ee7-1e5df4117ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:43:58.250035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2cecf-2c32-4eb8-9ee7-1e5df4117ad7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:43:58.256746 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 635/1246] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:43:58 2022] GET /identity/v3/role_assignments?user.id=f3b12b26b87d438c8f4eb61c8a93b31d&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=2a865ee865184972b66c89d62f6071fd => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:00.810903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd099ca-6c87-4402-a511-1a7bcb710cc4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:00.811459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd099ca-6c87-4402-a511-1a7bcb710cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:00.811459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd099ca-6c87-4402-a511-1a7bcb710cc4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:00.812856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 612/1247] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:44:00.818824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bb08b-2731-40fd-98c4-dff5d6738a6a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:00.819368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bb08b-2731-40fd-98c4-dff5d6738a6a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:00.819368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bb08b-2731-40fd-98c4-dff5d6738a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:00.837251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b33bb08b-2731-40fd-98c4-dff5d6738a6a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:44:00.838513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b33bb08b-2731-40fd-98c4-dff5d6738a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:44:00.917496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 636/1248] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:44:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:44:00.942022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd099ca-6c87-4402-a511-1a7bcb710cc4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:01.052298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd099ca-6c87-4402-a511-1a7bcb710cc4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:01.090509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:01.091308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:01.091594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:01.091895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:01.103720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:44:01.113312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:01.114579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:01.115535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 613/1249] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:01.122015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bb08b-2731-40fd-98c4-dff5d6738a6a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:01.230442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bb08b-2731-40fd-98c4-dff5d6738a6a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:01.267140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:01.267824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:01.268138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:01.268414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:01.269176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:01.269471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:01.270855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:01.285719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 637/1250] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:01.292690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:01.410611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f88ab-3303-49da-8691-4001015bdbe6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:01.444542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:01.445343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:01.445626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:01.445900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:01.456596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:01.458366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:44:01.475294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:01.476536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:01.478256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:44:01.478256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:44:01.478256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:01.478256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:01.478256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 614/1251] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:01.482624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:01.590941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0783-796b-4de6-9b8a-6f982e6f2f32 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:01.630374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:01.631086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:01.631499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:01.631920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:01.632924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:01.633371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:01.635417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:01.654072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 638/1252] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:01.655063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:01.759520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba7bcc-6784-4caa-add5-7cc24b0683da None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:01.794714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:01.795529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:01.795807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:01.796145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:01.804493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:01.805950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:44:01.821093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:01.822847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:01.823822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 615/1253] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:01.830475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:01.935524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064ad3e-7a0c-4ebd-b667-136d9ce06271 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:01.970290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:01.971063 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:01.971421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:01.971701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:01.972577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:01.972964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:01.974629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:01.994758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 639/1254] 10.222.0.99 () {56 vars in 1143 bytes} [Fri May 13 14:44:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:02.003151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:02.122807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53080bf-9e84-482c-bb6c-6c7c88a0d57b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:02.161927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:02.162675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:02.163237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:02.163591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:02.236677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:02.238137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:02.339158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 616/1255] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:44:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:44:02.348448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:02.453028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e75ce0-22c5-4aaa-b819-22eaad5c1075 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:02.489528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:02.490422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:02.490740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:02.491011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:02.501811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:02.503493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:44:02.522850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:02.523796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:02.524751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:44:02.524751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:44:02.524751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:02.524751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:02.524751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 640/1256] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:02.530452 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:02.647434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942591-8a49-4d00-bcba-0bc07b493712 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:02.686280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:02.687012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:02.687299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:02.687685 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:02.688670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:02.689064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:02.690795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:02.704060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 617/1257] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:02.709823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:02.823800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9626a-8dba-4022-a0e7-2449c102f221 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:02.865042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:02.866310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:02.866732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:02.867073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:02.878388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:02.880416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:44:02.902018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:02.903166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:02.904288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 641/1258] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:02.909417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:03.021048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc3078-0dfd-4471-9590-8defd95f5c57 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:03.061155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b74b-000c-45d8-b18e-0192d570e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:03.061828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b74b-000c-45d8-b18e-0192d570e1ab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:03.062108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b74b-000c-45d8-b18e-0192d570e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:03.062381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b74b-000c-45d8-b18e-0192d570e1ab None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:03.063177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b74b-000c-45d8-b18e-0192d570e1ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:03.063486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b74b-000c-45d8-b18e-0192d570e1ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:03.064986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b74b-000c-45d8-b18e-0192d570e1ab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:03.077929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 618/1259] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:03.084597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:03.192552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacff03f-ca0c-4628-9741-59ef32b3de5a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:03.227194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff512687-da0e-42a8-962b-cd6c2cefdc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:03.227907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512687-da0e-42a8-962b-cd6c2cefdc63 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:03.228182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512687-da0e-42a8-962b-cd6c2cefdc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:03.228453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512687-da0e-42a8-962b-cd6c2cefdc63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:03.229442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff512687-da0e-42a8-962b-cd6c2cefdc63 None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=f3b12b26b87d438c8f4eb61c8a93b31d) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:03.230030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff512687-da0e-42a8-962b-cd6c2cefdc63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:03.231441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff512687-da0e-42a8-962b-cd6c2cefdc63 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:03.237963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 642/1260] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:44:03 2022] GET /identity/v3/role_assignments?user.id=f3b12b26b87d438c8f4eb61c8a93b31d&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:05.482162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b0cbd-0122-4732-be2c-76e6db3ac115 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:05.482742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b0cbd-0122-4732-be2c-76e6db3ac115 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:05.482742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b0cbd-0122-4732-be2c-76e6db3ac115 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:05.484139 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 619/1261] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:44:05.489601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412ade-96d8-4563-ba7c-c467f0e510c7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:05.490057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412ade-96d8-4563-ba7c-c467f0e510c7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:05.490154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89412ade-96d8-4563-ba7c-c467f0e510c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:05.508839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-89412ade-96d8-4563-ba7c-c467f0e510c7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:44:05.510074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-89412ade-96d8-4563-ba7c-c467f0e510c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:44:05.582783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 643/1262] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:44:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:44:05.605876 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b0cbd-0122-4732-be2c-76e6db3ac115 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:05.724471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b0cbd-0122-4732-be2c-76e6db3ac115 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:05.761458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:05.762442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:05.762870 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:05.763291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:05.777600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:44:05.789034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:05.790343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:05.791440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 620/1263] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:05.797236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412ade-96d8-4563-ba7c-c467f0e510c7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:05.908442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89412ade-96d8-4563-ba7c-c467f0e510c7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:05.944323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:05.944989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:05.945265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:05.945531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:05.946275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:05.946578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:05.948009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:05.956434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 644/1264] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:05.962944 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:06.099526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd874a-f19f-40a7-bf91-99f5e533bbcf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:06.141701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:06.142897 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:06.143318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:06.143731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:06.157483 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:06.158957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:44:06.176214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:06.177248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:06.178193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:44:06.178193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:44:06.178193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:06.178193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:06.178193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 621/1265] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:06.183698 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:06.304469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaa656-c2d9-47fb-bcad-198a5714380f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:06.341076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:06.341729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:06.342012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:06.342285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:06.343011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:06.343318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:06.344723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:06.356497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 645/1266] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:06.362996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:06.476963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511270b-58db-431b-8252-e4513efcfb81 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:06.514752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:06.515567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:06.515849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:06.516147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:06.523906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:06.525486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:44:06.539543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:06.540667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:06.542229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 622/1267] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:06.547104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:06.652561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b7cd-84f0-4016-bd67-5526351861f4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:06.687853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:06.688549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:06.688827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:06.689094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:06.689921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:06.690223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:06.691659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:06.710486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 646/1268] 10.222.0.99 () {56 vars in 1143 bytes} [Fri May 13 14:44:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:06.717304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:06.841498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f37e0e-4f73-4dcb-9038-36cbd1df8329 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:06.877001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:06.877769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:06.878046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:06.878328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:06.890226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:06.891702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:44:06.909334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:06.910298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:06.911219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:44:06.911219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:44:06.911219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:06.911219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:06.911219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 623/1269] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:06.916771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:07.022303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182809f-9fa9-4f8a-8411-e67afc5ea636 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:07.056403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:07.057104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:07.057385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:07.057667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:07.058383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:07.058686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:07.060090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:07.071146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 647/1270] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:07.080511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:07.184104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7131c6-6b2f-4a89-b08b-ffbd2d2e3bea None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:07.218950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:07.219738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:07.220056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:07.220314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:07.227172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:07.229030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:44:07.243004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:07.244581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:07.245723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 624/1271] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:07.252435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:07.358016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf031c3-2414-4d61-acab-6bf2bb16a549 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:07.392796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a6416-ede2-4f85-8b6a-3d05e08df250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:07.393746 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a6416-ede2-4f85-8b6a-3d05e08df250 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:07.394139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a6416-ede2-4f85-8b6a-3d05e08df250 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:07.394503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a6416-ede2-4f85-8b6a-3d05e08df250 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:07.395760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a6416-ede2-4f85-8b6a-3d05e08df250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:07.396201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a6416-ede2-4f85-8b6a-3d05e08df250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:07.398447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a6416-ede2-4f85-8b6a-3d05e08df250 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:07.418916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 648/1272] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:07.427189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:07.536702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3038ea5-02a8-4908-ace7-9c0f0f0e44f3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:07.572893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5ac2-739b-41a2-8dc9-f4e5a795b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:07.573800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5ac2-739b-41a2-8dc9-f4e5a795b49c None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:07.574084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5ac2-739b-41a2-8dc9-f4e5a795b49c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:07.574364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5ac2-739b-41a2-8dc9-f4e5a795b49c None admin] PATH_INFO: `/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/f3b12b26b87d438c8f4eb61c8a93b31d/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:07.576580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d5ac2-739b-41a2-8dc9-f4e5a795b49c None admin] RBAC: Authorizing `identity:create_grant(project_id=b41e4b8a3b6845f0a8e353b947334fe6, user_id=f3b12b26b87d438c8f4eb61c8a93b31d, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:07.578036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d5ac2-739b-41a2-8dc9-f4e5a795b49c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:07.594817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 625/1273] 10.222.0.99 () {58 vars in 1439 bytes} [Fri May 13 14:44:07 2022] PUT /identity/v3/projects/b41e4b8a3b6845f0a8e353b947334fe6/users/f3b12b26b87d438c8f4eb61c8a93b31d/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:44:09.764461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea58fc8-1e08-4eb7-835c-7dee127f6ff9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:09.764986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea58fc8-1e08-4eb7-835c-7dee127f6ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:09.764986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea58fc8-1e08-4eb7-835c-7dee127f6ff9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:09.766280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 649/1274] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:44:09.772837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c154103-86cc-4805-a915-bde2b2d7a09f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:09.773502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c154103-86cc-4805-a915-bde2b2d7a09f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:09.773656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c154103-86cc-4805-a915-bde2b2d7a09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:09.800961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9c154103-86cc-4805-a915-bde2b2d7a09f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:44:09.802853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9c154103-86cc-4805-a915-bde2b2d7a09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:44:09.888694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 626/1275] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:44:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:44:09.913210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea58fc8-1e08-4eb7-835c-7dee127f6ff9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:10.015650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea58fc8-1e08-4eb7-835c-7dee127f6ff9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:10.054202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:10.054989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:10.055267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:10.055553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:10.065889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:44:10.073371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:10.074436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:10.075590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 650/1276] 10.222.0.99 () {56 vars in 1096 bytes} [Fri May 13 14:44:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:10.084276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c154103-86cc-4805-a915-bde2b2d7a09f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:10.196629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c154103-86cc-4805-a915-bde2b2d7a09f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:10.231109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:10.231764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:10.232074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:10.232342 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:10.233073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:10.233375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:10.234750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:10.243094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 627/1277] 10.222.0.99 () {56 vars in 1099 bytes} [Fri May 13 14:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:10.251576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:10.357698 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1301c38-b726-49ed-891b-864d54a2df5e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:10.391489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:10.392300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:10.392581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:10.392858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:10.409988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:10.412292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:44:10.430710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:10.431885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:10.432918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:44:10.432918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:44:10.432918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:10.432918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:10.432918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 651/1278] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:10.440383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:10.544854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aca7a-416d-417c-b949-89c49ed10b7f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:10.582995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:10.583654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:10.583957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:10.584233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:10.584949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:10.585252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:10.586645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:10.597738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 628/1279] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:10.604403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:10.714819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e65e-1b39-40ac-a876-d4f112fcb58e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:10.748155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:10.748950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:10.749231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:10.749507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:10.756832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:10.758272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:44:10.772285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:10.773750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:10.774882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 652/1280] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:10.781752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:10.880260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dd003-1d00-497e-ab0a-9a2f6b7bd465 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:10.914017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:10.914678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:10.914952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:10.915228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:10.916421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:10.916734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:10.918213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:10.936633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 629/1281] 10.222.0.99 () {56 vars in 1143 bytes} [Fri May 13 14:44:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:10.945492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:11.043161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a684332-aad9-4906-b91f-9438bb1624fd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:11.078188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:11.078821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:11.079101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:11.079370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:11.145008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:11.146448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:11.250314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 653/1282] 10.222.0.99 () {58 vars in 1282 bytes} [Fri May 13 14:44:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:44:11.256577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:11.362910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6c28a-d009-49a2-86b8-38871be32dfa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:11.401203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:11.401995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:11.402278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:11.402555 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:11.412812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:11.414282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:44:11.433135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:11.434173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:11.435465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:44:11.435465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:44:11.435465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:44:11.435465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:11.435465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 630/1283] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:11.442451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:11.548479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebc37f-0f62-4ac5-9db5-19d9434ecf7e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:11.584830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:11.585487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:11.585768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:11.586042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:11.586760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:11.587070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:11.588640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:11.599904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 654/1284] 10.222.0.99 () {56 vars in 1109 bytes} [Fri May 13 14:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:44:11.605915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:11.709868 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f0eb6-2c2c-42e8-9838-cbe823f9642a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:11.747217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:11.748038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:11.748321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:11.748589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:11.755804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:11.757302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:44:11.771165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:11.772197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 13 14:44:11.773168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 631/1285] 10.222.0.99 () {56 vars in 1111 bytes} [Fri May 13 14:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:11.779124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:11.899379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39b18e-ddac-4a4d-8093-199919f7f5a9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:11.933711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0702-630d-4fcd-8cc3-0dfcaa1264e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:11.934460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0702-630d-4fcd-8cc3-0dfcaa1264e4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:11.934746 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0702-630d-4fcd-8cc3-0dfcaa1264e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:11.935015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0702-630d-4fcd-8cc3-0dfcaa1264e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:11.935800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec0702-630d-4fcd-8cc3-0dfcaa1264e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:11.936145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec0702-630d-4fcd-8cc3-0dfcaa1264e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:11.937597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec0702-630d-4fcd-8cc3-0dfcaa1264e4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:11.949399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 655/1286] 10.222.0.99 () {56 vars in 1148 bytes} [Fri May 13 14:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:11.955762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:12.054074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4cd6-26fa-4159-a6a5-6de2050894e8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:12.097852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a900b-b591-4782-87c0-61ee4379c66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:12.098490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a900b-b591-4782-87c0-61ee4379c66f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:12.098771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a900b-b591-4782-87c0-61ee4379c66f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:12.099040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a900b-b591-4782-87c0-61ee4379c66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:12.099857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a900b-b591-4782-87c0-61ee4379c66f None admin] RBAC: Adding query filter params (role.id=310ee24d9efc471eb557c89ee02ee46e, scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6, user.id=f3b12b26b87d438c8f4eb61c8a93b31d) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:12.100201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a900b-b591-4782-87c0-61ee4379c66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:12.101654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a900b-b591-4782-87c0-61ee4379c66f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:12.107703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 632/1287] 10.222.0.99 () {56 vars in 1374 bytes} [Fri May 13 14:44:11 2022] GET /identity/v3/role_assignments?user.id=f3b12b26b87d438c8f4eb61c8a93b31d&scope.project.id=b41e4b8a3b6845f0a8e353b947334fe6&role.id=310ee24d9efc471eb557c89ee02ee46e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:14.316383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76988b05-b248-48b9-a5e8-3edb81f32c48 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:14.316945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76988b05-b248-48b9-a5e8-3edb81f32c48 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:14.316945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76988b05-b248-48b9-a5e8-3edb81f32c48 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:14.318283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 656/1288] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:44:14.324655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e3d6-dc6a-4216-9f2e-2354314337f3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:14.325109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e3d6-dc6a-4216-9f2e-2354314337f3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:14.325232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365e3d6-dc6a-4216-9f2e-2354314337f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:14.347949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7365e3d6-dc6a-4216-9f2e-2354314337f3 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:44:14.349161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7365e3d6-dc6a-4216-9f2e-2354314337f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:44:14.416798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 633/1289] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:44:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:44:14.439074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76988b05-b248-48b9-a5e8-3edb81f32c48 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:14.545792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76988b05-b248-48b9-a5e8-3edb81f32c48 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:14.582442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:14.583181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:14.583465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:14.583741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:14.584429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:14.585816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:14.597639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:14.598809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:14.600066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 657/1290] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:44:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:14.606384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365e3d6-dc6a-4216-9f2e-2354314337f3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:14.718045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365e3d6-dc6a-4216-9f2e-2354314337f3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:14.763948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d87d36-4406-45ca-864e-614ec1a275af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:14.764607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d87d36-4406-45ca-864e-614ec1a275af None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:14.764888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d87d36-4406-45ca-864e-614ec1a275af None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:14.765162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d87d36-4406-45ca-864e-614ec1a275af None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:14.765866 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d87d36-4406-45ca-864e-614ec1a275af None admin] RBAC: Adding query filter params (name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:14.766173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d87d36-4406-45ca-864e-614ec1a275af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:14.767563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d87d36-4406-45ca-864e-614ec1a275af None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:14.772431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 634/1291] 10.222.0.99 () {56 vars in 1116 bytes} [Fri May 13 14:44:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:14.778394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:14.903102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0992e-65be-4e09-ac5c-88bf1203c089 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:14.948171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c22f2a-aca2-4b25-9349-f73129aa7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:14.948836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c22f2a-aca2-4b25-9349-f73129aa7712 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:14.949112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c22f2a-aca2-4b25-9349-f73129aa7712 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:14.949382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c22f2a-aca2-4b25-9349-f73129aa7712 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:14.950089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c22f2a-aca2-4b25-9349-f73129aa7712 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:14.950392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c22f2a-aca2-4b25-9349-f73129aa7712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:14.951764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c22f2a-aca2-4b25-9349-f73129aa7712 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:14.956401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 658/1292] 10.222.0.99 () {56 vars in 1116 bytes} [Fri May 13 14:44:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:17.138153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e13a2-0ce6-4182-aba0-f308fa7249c7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:17.138710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e13a2-0ce6-4182-aba0-f308fa7249c7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:17.138710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e13a2-0ce6-4182-aba0-f308fa7249c7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:17.140102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 635/1293] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:44:17.146374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fed7fe-34a8-4607-818e-2e223c9ac211 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:17.147104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fed7fe-34a8-4607-818e-2e223c9ac211 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:17.147247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fed7fe-34a8-4607-818e-2e223c9ac211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:17.169285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-78fed7fe-34a8-4607-818e-2e223c9ac211 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:44:17.170443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-78fed7fe-34a8-4607-818e-2e223c9ac211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:44:17.247128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 659/1294] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:44:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:44:17.270312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e13a2-0ce6-4182-aba0-f308fa7249c7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:17.379232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e13a2-0ce6-4182-aba0-f308fa7249c7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:17.413230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662572-e134-44e2-87f3-28719f95da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:17.413803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662572-e134-44e2-87f3-28719f95da44 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:17.414088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662572-e134-44e2-87f3-28719f95da44 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:17.414358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662572-e134-44e2-87f3-28719f95da44 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:17.415162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab662572-e134-44e2-87f3-28719f95da44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:17.416621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab662572-e134-44e2-87f3-28719f95da44 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:17.435456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 636/1295] 10.222.0.99 () {60 vars in 1141 bytes} [Fri May 13 14:44:17 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:44:19.668899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78f48-3f1d-4dbf-9e78-bf392f20f193 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:19.669436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78f48-3f1d-4dbf-9e78-bf392f20f193 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:19.669526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78f48-3f1d-4dbf-9e78-bf392f20f193 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:19.671583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 660/1296] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:44:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:44:19.679587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98372-249b-493f-ae4c-5cb226a87c0d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:19.680152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98372-249b-493f-ae4c-5cb226a87c0d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:19.680244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98372-249b-493f-ae4c-5cb226a87c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:19.698268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-adc98372-249b-493f-ae4c-5cb226a87c0d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:44:19.699441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-adc98372-249b-493f-ae4c-5cb226a87c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:44:19.782040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 637/1297] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:44:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:44:19.813394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f78f48-3f1d-4dbf-9e78-bf392f20f193 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:19.939184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f78f48-3f1d-4dbf-9e78-bf392f20f193 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:19.977985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:19.978784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:19.979066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:19.979339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:19.979995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:19.981386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:19.993486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:19.994605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:19.996130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 661/1298] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:44:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:20.004046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98372-249b-493f-ae4c-5cb226a87c0d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:20.114453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98372-249b-493f-ae4c-5cb226a87c0d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:20.149746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:20.150394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:20.150678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:20.150949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:20.151655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:20.151984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:20.153375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:20.158534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 638/1299] 10.222.0.99 () {56 vars in 1116 bytes} [Fri May 13 14:44:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:20.167044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:20.278376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637ddb6-0aa3-4c77-8878-1f770918c63e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:20.312905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7e0d-69ed-4cd8-81a8-104adb503486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:20.313562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7e0d-69ed-4cd8-81a8-104adb503486 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:20.313835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7e0d-69ed-4cd8-81a8-104adb503486 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:20.314106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7e0d-69ed-4cd8-81a8-104adb503486 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:20.314890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7e0d-69ed-4cd8-81a8-104adb503486 None admin] RBAC: Adding query filter params (interface=public, service_id=8059764003104440b449812802ddef18, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:20.315196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7e0d-69ed-4cd8-81a8-104adb503486 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:20.316590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7e0d-69ed-4cd8-81a8-104adb503486 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:20.322177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 662/1300] 10.222.0.99 () {56 vars in 1251 bytes} [Fri May 13 14:44:20 2022] GET /identity/v3/endpoints?service_id=8059764003104440b449812802ddef18&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:20.328445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:20.431147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e21b6-3f19-4efa-a2a0-08001748354c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:20.469114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bef68-ac0a-4ae2-b577-4ea90cf03c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:20.469768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bef68-ac0a-4ae2-b577-4ea90cf03c48 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:20.470055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bef68-ac0a-4ae2-b577-4ea90cf03c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:20.470306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bef68-ac0a-4ae2-b577-4ea90cf03c48 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:20.471002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bef68-ac0a-4ae2-b577-4ea90cf03c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:20.472434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bef68-ac0a-4ae2-b577-4ea90cf03c48 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:20.479408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 639/1301] 10.222.0.99 () {56 vars in 1087 bytes} [Fri May 13 14:44:20 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:44:22.717288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455416c-bea4-42d3-b19b-157f4364b881 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:22.718176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455416c-bea4-42d3-b19b-157f4364b881 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:22.718176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455416c-bea4-42d3-b19b-157f4364b881 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:22.720419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 663/1302] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:44:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:44:22.726662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f1ac-c1bd-4bf2-80bf-45292576c533 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:22.727348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f1ac-c1bd-4bf2-80bf-45292576c533 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:22.727522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f1ac-c1bd-4bf2-80bf-45292576c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:22.747888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-33b2f1ac-c1bd-4bf2-80bf-45292576c533 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:44:22.749097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-33b2f1ac-c1bd-4bf2-80bf-45292576c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:44:22.817291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 640/1303] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:44:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:44:22.848435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455416c-bea4-42d3-b19b-157f4364b881 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:22.966481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455416c-bea4-42d3-b19b-157f4364b881 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:23.000221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:23.001012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:23.001290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:23.001559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:23.002202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:23.003562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:44:23.015576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:44:23.019949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 13 14:44:23.021110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 664/1304] 10.222.0.99 () {56 vars in 1117 bytes} [Fri May 13 14:44:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:44:23.023152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2f1ac-c1bd-4bf2-80bf-45292576c533 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:23.122526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2f1ac-c1bd-4bf2-80bf-45292576c533 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:23.157188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b59d-db5a-477e-bf64-341517b789d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:23.157838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b59d-db5a-477e-bf64-341517b789d3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:23.158117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b59d-db5a-477e-bf64-341517b789d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:23.158387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b59d-db5a-477e-bf64-341517b789d3 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:23.159093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b59d-db5a-477e-bf64-341517b789d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:44:23.159396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b59d-db5a-477e-bf64-341517b789d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:23.160816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b59d-db5a-477e-bf64-341517b789d3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:23.165998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 641/1305] 10.222.0.99 () {56 vars in 1116 bytes} [Fri May 13 14:44:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:44:23.175184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:44:23.278400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659be7b3-fa70-4485-89ff-ec01aca9c0d3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:44:23.312153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06b72d-0957-48f3-8e12-4896cd045000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:44:23.312694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b72d-0957-48f3-8e12-4896cd045000 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:44:23.312972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b72d-0957-48f3-8e12-4896cd045000 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:44:23.313241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b72d-0957-48f3-8e12-4896cd045000 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:44:23.313974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06b72d-0957-48f3-8e12-4896cd045000 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:44:23.315356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06b72d-0957-48f3-8e12-4896cd045000 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:44:23.337532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 665/1306] 10.222.0.99 () {60 vars in 1144 bytes} [Fri May 13 14:44:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:45:27.943277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac10b-a3c2-4597-be87-6a13d3c5ea44 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:27.944197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac10b-a3c2-4597-be87-6a13d3c5ea44 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:27.944634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac10b-a3c2-4597-be87-6a13d3c5ea44 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:27.952000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4af9a-e3c8-4210-9264-51d61a03a92f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:27.952757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4af9a-e3c8-4210-9264-51d61a03a92f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:27.953207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4af9a-e3c8-4210-9264-51d61a03a92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:27.957160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 642/1307] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:28.035329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-fcb4af9a-e3c8-4210-9264-51d61a03a92f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:28.036831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fcb4af9a-e3c8-4210-9264-51d61a03a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:28.230266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 666/1308] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:28.262358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a8ee-2562-4ee4-b94f-2d479ae3a2e2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:28.262541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a8ee-2562-4ee4-b94f-2d479ae3a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:28.262808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a8ee-2562-4ee4-b94f-2d479ae3a2e2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:28.264543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 643/1309] 10.222.0.99 () {54 vars in 964 bytes} [Fri May 13 14:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:28.272477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117686c-6904-451a-b620-9e29e67758aa None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:28.273256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117686c-6904-451a-b620-9e29e67758aa None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:28.274006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117686c-6904-451a-b620-9e29e67758aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:28.408865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0117686c-6904-451a-b620-9e29e67758aa None None] MFA Rules not processed for user `81e8247739e24fcd9b067f1aa1cb9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:28.410438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0117686c-6904-451a-b620-9e29e67758aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:28.494816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 667/1310] 10.222.0.99 () {58 vars in 1061 bytes} [Fri May 13 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:45:28.504020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a8ee-2562-4ee4-b94f-2d479ae3a2e2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:28.506157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6c51a8ee-2562-4ee4-b94f-2d479ae3a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:28.638412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a8ee-2562-4ee4-b94f-2d479ae3a2e2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:28.718855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216f6c-e49d-4b32-9890-e1ff7462f6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:28.719508 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216f6c-e49d-4b32-9890-e1ff7462f6cc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:28.719746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216f6c-e49d-4b32-9890-e1ff7462f6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:28.720050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216f6c-e49d-4b32-9890-e1ff7462f6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:28.721716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86216f6c-e49d-4b32-9890-e1ff7462f6cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:28.834837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216f6c-e49d-4b32-9890-e1ff7462f6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:28.836271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216f6c-e49d-4b32-9890-e1ff7462f6cc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:28.856940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 644/1311] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:31.396720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248d21-1283-4428-89ab-63c80a326396 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:31.397701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248d21-1283-4428-89ab-63c80a326396 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:31.398105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248d21-1283-4428-89ab-63c80a326396 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:31.399834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 668/1312] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:31.405543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239c073-0a71-4db1-83e9-8164e1ad3093 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:31.405997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239c073-0a71-4db1-83e9-8164e1ad3093 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:31.406098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239c073-0a71-4db1-83e9-8164e1ad3093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:31.478791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1239c073-0a71-4db1-83e9-8164e1ad3093 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:31.479947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1239c073-0a71-4db1-83e9-8164e1ad3093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:31.590540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 645/1313] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:45:31.628475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248d21-1283-4428-89ab-63c80a326396 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:31.630712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-da248d21-1283-4428-89ab-63c80a326396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:31.738717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248d21-1283-4428-89ab-63c80a326396 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:31.813121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109613a-749b-4a2a-b4e7-ef72c86c4da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:31.813790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109613a-749b-4a2a-b4e7-ef72c86c4da2 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:31.814069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109613a-749b-4a2a-b4e7-ef72c86c4da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:31.814340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109613a-749b-4a2a-b4e7-ef72c86c4da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:31.816127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7109613a-749b-4a2a-b4e7-ef72c86c4da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:31.934896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109613a-749b-4a2a-b4e7-ef72c86c4da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:31.936319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109613a-749b-4a2a-b4e7-ef72c86c4da2 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:31.955733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 669/1314] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:34.530562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13a13-0ebf-4ea8-82d5-61bc849c8307 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:34.531059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13a13-0ebf-4ea8-82d5-61bc849c8307 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:34.531163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13a13-0ebf-4ea8-82d5-61bc849c8307 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:34.532553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 646/1315] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:34.538191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61fbe-d580-446b-a7f9-02bc4deb356f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:34.538648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61fbe-d580-446b-a7f9-02bc4deb356f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:34.538736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61fbe-d580-446b-a7f9-02bc4deb356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:34.602811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9bc61fbe-d580-446b-a7f9-02bc4deb356f None None] MFA Rules not processed for user `fd33b2c007f946f2967e45b02ef6025f`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:34.604063 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9bc61fbe-d580-446b-a7f9-02bc4deb356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:34.710565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 670/1316] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:34.775730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1ad5-5777-47bd-a856-31f9ca3e0701 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:34.776021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1ad5-5777-47bd-a856-31f9ca3e0701 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:34.776413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1ad5-5777-47bd-a856-31f9ca3e0701 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:34.778936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 647/1317] 10.222.0.99 () {54 vars in 964 bytes} [Fri May 13 14:45:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:34.787512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d356-e181-4183-a4d9-7469045004e0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:34.787807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d356-e181-4183-a4d9-7469045004e0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:34.788109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d356-e181-4183-a4d9-7469045004e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:34.863181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5a26d356-e181-4183-a4d9-7469045004e0 None None] MFA Rules not processed for user `81e8247739e24fcd9b067f1aa1cb9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:34.864416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5a26d356-e181-4183-a4d9-7469045004e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:34.940210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 671/1318] 10.222.0.99 () {58 vars in 1061 bytes} [Fri May 13 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:34.955230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd1ad5-5777-47bd-a856-31f9ca3e0701 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:34.957519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4fd1ad5-5777-47bd-a856-31f9ca3e0701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:35.072919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd1ad5-5777-47bd-a856-31f9ca3e0701 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:35.159462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942b2a-c981-4e6a-a733-db300fea7693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:35.160143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942b2a-c981-4e6a-a733-db300fea7693 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:35.160421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942b2a-c981-4e6a-a733-db300fea7693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:35.160672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942b2a-c981-4e6a-a733-db300fea7693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:35.162316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-68942b2a-c981-4e6a-a733-db300fea7693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:35.278048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942b2a-c981-4e6a-a733-db300fea7693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:35.279549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942b2a-c981-4e6a-a733-db300fea7693 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:35.298027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 648/1319] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:45:38.494175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6e88-e9c8-472e-bbc3-2ea988176698 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:38.494991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6e88-e9c8-472e-bbc3-2ea988176698 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:38.494991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6e88-e9c8-472e-bbc3-2ea988176698 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:38.497084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 672/1320] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:38.502863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7157e0-7c7e-4d66-8849-4b61c57acf57 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:38.503339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7157e0-7c7e-4d66-8849-4b61c57acf57 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:38.503481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7157e0-7c7e-4d66-8849-4b61c57acf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:38.567591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ee7157e0-7c7e-4d66-8849-4b61c57acf57 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:38.568809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ee7157e0-7c7e-4d66-8849-4b61c57acf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:38.682119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 649/1321] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:45:38.725126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6e88-e9c8-472e-bbc3-2ea988176698 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:38.727097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-14fa6e88-e9c8-472e-bbc3-2ea988176698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:38.855610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6e88-e9c8-472e-bbc3-2ea988176698 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:38.938186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0453007-ca1f-4d77-a0c4-5cd3c505bb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:38.938839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0453007-ca1f-4d77-a0c4-5cd3c505bb8d service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:38.939124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0453007-ca1f-4d77-a0c4-5cd3c505bb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:38.939399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0453007-ca1f-4d77-a0c4-5cd3c505bb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:38.941104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b0453007-ca1f-4d77-a0c4-5cd3c505bb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:39.063341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0453007-ca1f-4d77-a0c4-5cd3c505bb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:39.064821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0453007-ca1f-4d77-a0c4-5cd3c505bb8d service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:39.083742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 673/1322] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:42.010887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63eaf2-0d93-4998-a473-1abce970bc81 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:42.011455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63eaf2-0d93-4998-a473-1abce970bc81 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:42.011455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63eaf2-0d93-4998-a473-1abce970bc81 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:42.012845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 650/1323] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:42.018212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48035d-86fb-4e88-8d61-ea8bb017fd79 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:42.018790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48035d-86fb-4e88-8d61-ea8bb017fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:42.019475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48035d-86fb-4e88-8d61-ea8bb017fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:42.085982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5c48035d-86fb-4e88-8d61-ea8bb017fd79 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:42.087198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5c48035d-86fb-4e88-8d61-ea8bb017fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:42.184905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 674/1324] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:42.221565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63eaf2-0d93-4998-a473-1abce970bc81 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:42.223216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7a63eaf2-0d93-4998-a473-1abce970bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:42.328374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63eaf2-0d93-4998-a473-1abce970bc81 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:42.403578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5914ad-5d96-41be-bc70-a41bca361818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:42.404284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5914ad-5d96-41be-bc70-a41bca361818 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:42.404568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5914ad-5d96-41be-bc70-a41bca361818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:42.404845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5914ad-5d96-41be-bc70-a41bca361818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:42.406523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ad5914ad-5d96-41be-bc70-a41bca361818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:42.531928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5914ad-5d96-41be-bc70-a41bca361818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:42.533420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5914ad-5d96-41be-bc70-a41bca361818 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:42.553888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 651/1325] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:44.840514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f8ea-e51e-4c2e-9ac4-c3a592556c5f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:44.841044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f8ea-e51e-4c2e-9ac4-c3a592556c5f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:44.841044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f8ea-e51e-4c2e-9ac4-c3a592556c5f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:44.842366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 675/1326] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:44.848107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6465-1830-4e0c-a3d5-1096494e669e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:44.848516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6465-1830-4e0c-a3d5-1096494e669e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:44.848696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f6465-1830-4e0c-a3d5-1096494e669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:44.923657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b82f6465-1830-4e0c-a3d5-1096494e669e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:44.925065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b82f6465-1830-4e0c-a3d5-1096494e669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:45.025983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 652/1327] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:45.062785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f8ea-e51e-4c2e-9ac4-c3a592556c5f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:45.064453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-db34f8ea-e51e-4c2e-9ac4-c3a592556c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:45.171740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f8ea-e51e-4c2e-9ac4-c3a592556c5f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:45.251763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85d21a-e778-47aa-a77d-7d4af9f80967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:45.252666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d21a-e778-47aa-a77d-7d4af9f80967 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:45.253445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d21a-e778-47aa-a77d-7d4af9f80967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:45.253729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85d21a-e778-47aa-a77d-7d4af9f80967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:45.255388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7c85d21a-e778-47aa-a77d-7d4af9f80967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:45.367744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85d21a-e778-47aa-a77d-7d4af9f80967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:45.369256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85d21a-e778-47aa-a77d-7d4af9f80967 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:45.387390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 676/1328] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:47.641894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6994a-b908-4aa5-aad2-f2e84284a06b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:47.642485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6994a-b908-4aa5-aad2-f2e84284a06b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:47.642485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6994a-b908-4aa5-aad2-f2e84284a06b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:47.644161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 653/1329] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:47.649473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545dd8d-db33-47d9-b3e7-a1caaa0da747 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:47.649935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545dd8d-db33-47d9-b3e7-a1caaa0da747 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:47.650027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545dd8d-db33-47d9-b3e7-a1caaa0da747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:47.716787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f545dd8d-db33-47d9-b3e7-a1caaa0da747 None None] MFA Rules not processed for user `fd33b2c007f946f2967e45b02ef6025f`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:47.718019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f545dd8d-db33-47d9-b3e7-a1caaa0da747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:47.824400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 677/1330] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:47.862111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6994a-b908-4aa5-aad2-f2e84284a06b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:47.863703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4fe6994a-b908-4aa5-aad2-f2e84284a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:47.969902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6994a-b908-4aa5-aad2-f2e84284a06b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:48.045988 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1777b-a2aa-44e4-81fd-ef7d394f31e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:48.046644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1777b-a2aa-44e4-81fd-ef7d394f31e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:48.046928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1777b-a2aa-44e4-81fd-ef7d394f31e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:48.047200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1777b-a2aa-44e4-81fd-ef7d394f31e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:48.048950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8cd1777b-a2aa-44e4-81fd-ef7d394f31e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:48.158959 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1777b-a2aa-44e4-81fd-ef7d394f31e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:48.160457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1777b-a2aa-44e4-81fd-ef7d394f31e6 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:48.178767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 654/1331] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:50.644664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea5b9-57d1-433c-9214-85e56f55d05c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:50.645080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea5b9-57d1-433c-9214-85e56f55d05c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:50.645080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea5b9-57d1-433c-9214-85e56f55d05c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:50.646517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 678/1332] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:50.652405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0443796-c658-45f7-b8fd-8c9a4b631965 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:50.652823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0443796-c658-45f7-b8fd-8c9a4b631965 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:50.652962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0443796-c658-45f7-b8fd-8c9a4b631965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:50.729268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c0443796-c658-45f7-b8fd-8c9a4b631965 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:50.730490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c0443796-c658-45f7-b8fd-8c9a4b631965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:50.829046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 655/1333] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:50.871538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ea5b9-57d1-433c-9214-85e56f55d05c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:50.873127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-931ea5b9-57d1-433c-9214-85e56f55d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:50.978626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ea5b9-57d1-433c-9214-85e56f55d05c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:51.058897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa7ee-11ff-467c-b307-8fa0f6059094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:51.059554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa7ee-11ff-467c-b307-8fa0f6059094 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:51.059836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa7ee-11ff-467c-b307-8fa0f6059094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:51.060134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa7ee-11ff-467c-b307-8fa0f6059094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:51.061789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dd5fa7ee-11ff-467c-b307-8fa0f6059094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:51.174703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa7ee-11ff-467c-b307-8fa0f6059094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:51.176186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa7ee-11ff-467c-b307-8fa0f6059094 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:51.195763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 679/1334] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:53.478127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caf699-fe7a-421d-95c3-23e66e8c2607 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:53.478687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caf699-fe7a-421d-95c3-23e66e8c2607 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:53.478687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caf699-fe7a-421d-95c3-23e66e8c2607 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:53.480119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 656/1335] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:53.486307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6799e1-9caf-426d-9c01-11fb9fbc8623 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:53.486725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6799e1-9caf-426d-9c01-11fb9fbc8623 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:53.486835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6799e1-9caf-426d-9c01-11fb9fbc8623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:53.560720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1a6799e1-9caf-426d-9c01-11fb9fbc8623 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:53.561950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1a6799e1-9caf-426d-9c01-11fb9fbc8623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:53.663074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 680/1336] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:53.707728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caf699-fe7a-421d-95c3-23e66e8c2607 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:53.710279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19caf699-fe7a-421d-95c3-23e66e8c2607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:53.834518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caf699-fe7a-421d-95c3-23e66e8c2607 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:53.906250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb4492-350c-4a0f-86f6-6988f27a29b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:53.906900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4492-350c-4a0f-86f6-6988f27a29b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:53.907178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4492-350c-4a0f-86f6-6988f27a29b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:53.907476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4492-350c-4a0f-86f6-6988f27a29b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:53.909124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4bdb4492-350c-4a0f-86f6-6988f27a29b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:54.015023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb4492-350c-4a0f-86f6-6988f27a29b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:54.016441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb4492-350c-4a0f-86f6-6988f27a29b0 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:54.034199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 657/1337] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:45:56.687787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93478b7c-a659-4f98-9c45-1105f1283025 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:56.689087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93478b7c-a659-4f98-9c45-1105f1283025 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:56.689411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93478b7c-a659-4f98-9c45-1105f1283025 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:56.690892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 681/1338] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:45:56.699930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5743-00e1-48b8-bfcd-4892b474f413 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:56.700445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5743-00e1-48b8-bfcd-4892b474f413 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:56.701137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5743-00e1-48b8-bfcd-4892b474f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:56.784011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-976a5743-00e1-48b8-bfcd-4892b474f413 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:45:56.785176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-976a5743-00e1-48b8-bfcd-4892b474f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:56.893781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 658/1339] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:45:56.932826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93478b7c-a659-4f98-9c45-1105f1283025 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:45:56.935355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-93478b7c-a659-4f98-9c45-1105f1283025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:57.063378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93478b7c-a659-4f98-9c45-1105f1283025 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:45:57.153413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddd455-f47c-43f1-9141-9e07c5560a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:45:57.154064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd455-f47c-43f1-9141-9e07c5560a7f service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:45:57.154343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd455-f47c-43f1-9141-9e07c5560a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:45:57.154613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd455-f47c-43f1-9141-9e07c5560a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:45:57.156273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aaddd455-f47c-43f1-9141-9e07c5560a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:45:57.266651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddd455-f47c-43f1-9141-9e07c5560a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:45:57.268336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddd455-f47c-43f1-9141-9e07c5560a7f service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:45:57.287621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 682/1340] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:01.696511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f552c5c-55f2-4f5a-beaf-c89307bb0cd7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:01.697125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f552c5c-55f2-4f5a-beaf-c89307bb0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:01.697125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f552c5c-55f2-4f5a-beaf-c89307bb0cd7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:01.698419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 659/1341] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:01.705030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c486cd-f455-49f0-a4a4-bcbbbf7f5726 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:01.705532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c486cd-f455-49f0-a4a4-bcbbbf7f5726 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:01.705630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c486cd-f455-49f0-a4a4-bcbbbf7f5726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:01.789700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d9c486cd-f455-49f0-a4a4-bcbbbf7f5726 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:01.790938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d9c486cd-f455-49f0-a4a4-bcbbbf7f5726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:01.924400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 683/1342] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:01.963180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f552c5c-55f2-4f5a-beaf-c89307bb0cd7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:01.965794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4f552c5c-55f2-4f5a-beaf-c89307bb0cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:02.064299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f552c5c-55f2-4f5a-beaf-c89307bb0cd7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:02.068205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab781f-943f-4f23-b089-fe81678f3c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:02.068857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab781f-943f-4f23-b089-fe81678f3c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:02.069137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab781f-943f-4f23-b089-fe81678f3c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:02.069406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab781f-943f-4f23-b089-fe81678f3c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:02.079141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab781f-943f-4f23-b089-fe81678f3c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:02.080609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab781f-943f-4f23-b089-fe81678f3c18 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:02.089969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 660/1343] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:05.030915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627cd4f-9c9a-4893-a084-151a4212e556 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:05.031512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627cd4f-9c9a-4893-a084-151a4212e556 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:05.031512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627cd4f-9c9a-4893-a084-151a4212e556 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:05.033071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 684/1344] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:05.038472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b07b-2ab6-4987-bd1a-38df4dbe3b19 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:05.038935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b07b-2ab6-4987-bd1a-38df4dbe3b19 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:05.039046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b07b-2ab6-4987-bd1a-38df4dbe3b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:05.067179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3856b07b-2ab6-4987-bd1a-38df4dbe3b19 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:05.068464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3856b07b-2ab6-4987-bd1a-38df4dbe3b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:05.149313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 661/1345] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:05.185966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627cd4f-9c9a-4893-a084-151a4212e556 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:05.198248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627cd4f-9c9a-4893-a084-151a4212e556 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:05.202284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0bce1-e4bf-4682-b660-b10ba82a98b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:05.203058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0bce1-e4bf-4682-b660-b10ba82a98b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:05.203344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0bce1-e4bf-4682-b660-b10ba82a98b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:05.203657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0bce1-e4bf-4682-b660-b10ba82a98b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:05.214296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0bce1-e4bf-4682-b660-b10ba82a98b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:05.215746 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0bce1-e4bf-4682-b660-b10ba82a98b9 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:05.226812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 685/1346] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:09.691385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4120-fe77-4803-a171-537082bee0ed None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:09.692007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4120-fe77-4803-a171-537082bee0ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:09.692007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4120-fe77-4803-a171-537082bee0ed None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:09.693288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 662/1347] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:09.698905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864d0b2-4533-42fe-937a-c43035d395dd None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:09.699326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864d0b2-4533-42fe-937a-c43035d395dd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:09.699432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864d0b2-4533-42fe-937a-c43035d395dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:09.717512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d864d0b2-4533-42fe-937a-c43035d395dd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:09.718733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d864d0b2-4533-42fe-937a-c43035d395dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:09.727292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 686/1348] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:09.764774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4120-fe77-4803-a171-537082bee0ed None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:09.767553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17df4120-fe77-4803-a171-537082bee0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:09.783095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4120-fe77-4803-a171-537082bee0ed None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:09.786077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3d411-d1ce-4e9a-b690-8bffa14b7975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:09.786733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3d411-d1ce-4e9a-b690-8bffa14b7975 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:09.787009 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3d411-d1ce-4e9a-b690-8bffa14b7975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:09.787283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3d411-d1ce-4e9a-b690-8bffa14b7975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:09.797091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3d411-d1ce-4e9a-b690-8bffa14b7975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:09.798576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3d411-d1ce-4e9a-b690-8bffa14b7975 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:09.810604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 663/1349] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:15.192743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d96e3f-a8ae-42a0-9e96-947eeadc9b9f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:15.193659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d96e3f-a8ae-42a0-9e96-947eeadc9b9f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:15.195384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d96e3f-a8ae-42a0-9e96-947eeadc9b9f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:15.197780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 687/1350] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:46:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:15.202932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b0b9-ae79-4c5f-8cc2-1c2de03f5934 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:15.203357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b0b9-ae79-4c5f-8cc2-1c2de03f5934 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:15.203473 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b0b9-ae79-4c5f-8cc2-1c2de03f5934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:15.281046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b181b0b9-ae79-4c5f-8cc2-1c2de03f5934 None None] MFA Rules not processed for user `f3b12b26b87d438c8f4eb61c8a93b31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:15.282792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b181b0b9-ae79-4c5f-8cc2-1c2de03f5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:15.391360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 664/1351] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:19.835626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def03da-6471-4926-8cbf-2bdbe0cde410 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:19.836282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def03da-6471-4926-8cbf-2bdbe0cde410 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:19.836282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def03da-6471-4926-8cbf-2bdbe0cde410 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:19.837679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 688/1352] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:19.843161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fd97c-86f1-4477-a231-38c4cd4f52cd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:19.843621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fd97c-86f1-4477-a231-38c4cd4f52cd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:19.844208 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fd97c-86f1-4477-a231-38c4cd4f52cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:19.864953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6e3fd97c-86f1-4477-a231-38c4cd4f52cd None None] MFA Rules not processed for user `f3b12b26b87d438c8f4eb61c8a93b31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:19.866384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e3fd97c-86f1-4477-a231-38c4cd4f52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:19.875761 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 665/1353] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:21.363784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1da1-1dc4-4dac-ac78-01648ce7736b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:21.364394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1da1-1dc4-4dac-ac78-01648ce7736b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:21.364485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1da1-1dc4-4dac-ac78-01648ce7736b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:21.365899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 689/1354] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:21.370976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb84a-5f02-4381-b8d5-7fd43c672fe9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:21.371446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb84a-5f02-4381-b8d5-7fd43c672fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:21.371657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb84a-5f02-4381-b8d5-7fd43c672fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:21.390559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-687fb84a-5f02-4381-b8d5-7fd43c672fe9 None None] MFA Rules not processed for user `f3b12b26b87d438c8f4eb61c8a93b31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:21.391850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-687fb84a-5f02-4381-b8d5-7fd43c672fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:21.401309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 666/1355] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:25.197401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c62c-ec0b-4b1b-ad2b-d090827907bd None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:25.197927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c62c-ec0b-4b1b-ad2b-d090827907bd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:25.197927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c62c-ec0b-4b1b-ad2b-d090827907bd None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:25.199648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 690/1356] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:25.205210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a146-dab1-45e7-bb75-0db5baf73db7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:25.205671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a146-dab1-45e7-bb75-0db5baf73db7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:25.205781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a146-dab1-45e7-bb75-0db5baf73db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:25.223704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8774a146-dab1-45e7-bb75-0db5baf73db7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:25.224966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8774a146-dab1-45e7-bb75-0db5baf73db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:25.233397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 667/1357] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:25.281598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9ca27-7073-483f-ae05-d917efd463f0 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:25.282089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9ca27-7073-483f-ae05-d917efd463f0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:25.282463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9ca27-7073-483f-ae05-d917efd463f0 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:25.283940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 691/1358] 10.222.0.99 () {54 vars in 961 bytes} [Fri May 13 14:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:25.289286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594fc2-5507-46c0-b0fe-8d39b9f8bd80 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:25.289542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594fc2-5507-46c0-b0fe-8d39b9f8bd80 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:25.290025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594fc2-5507-46c0-b0fe-8d39b9f8bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:25.339292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d8594fc2-5507-46c0-b0fe-8d39b9f8bd80 None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:25.340651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d8594fc2-5507-46c0-b0fe-8d39b9f8bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:25.420173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 668/1359] 10.222.0.99 () {58 vars in 1058 bytes} [Fri May 13 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:25.428418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9ca27-7073-483f-ae05-d917efd463f0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:25.442947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9ca27-7073-483f-ae05-d917efd463f0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:25.448629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45dd8-2ea6-4476-aebb-3628772a03bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:25.449321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45dd8-2ea6-4476-aebb-3628772a03bf service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:25.449703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45dd8-2ea6-4476-aebb-3628772a03bf service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:25.450077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45dd8-2ea6-4476-aebb-3628772a03bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:25.458867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45dd8-2ea6-4476-aebb-3628772a03bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:25.460629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45dd8-2ea6-4476-aebb-3628772a03bf service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:25.470730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 692/1360] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:27.897637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520c34-0f83-4349-b4bd-1b39cd4a3cc2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:27.898176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520c34-0f83-4349-b4bd-1b39cd4a3cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:27.898176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520c34-0f83-4349-b4bd-1b39cd4a3cc2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:27.899676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 669/1361] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:27.904909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156684c3-fab6-437c-afd6-b5aec8fb300a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:27.905330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156684c3-fab6-437c-afd6-b5aec8fb300a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:27.905458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156684c3-fab6-437c-afd6-b5aec8fb300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:27.924131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-156684c3-fab6-437c-afd6-b5aec8fb300a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:27.925348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-156684c3-fab6-437c-afd6-b5aec8fb300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:27.934785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 693/1362] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:27.978898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74520c34-0f83-4349-b4bd-1b39cd4a3cc2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:27.996825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74520c34-0f83-4349-b4bd-1b39cd4a3cc2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:28.003177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bcfc9-b6d2-4196-a8e4-1aeb94764613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:28.004017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bcfc9-b6d2-4196-a8e4-1aeb94764613 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:28.004384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bcfc9-b6d2-4196-a8e4-1aeb94764613 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:28.004719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bcfc9-b6d2-4196-a8e4-1aeb94764613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:28.014521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bcfc9-b6d2-4196-a8e4-1aeb94764613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:28.016168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bcfc9-b6d2-4196-a8e4-1aeb94764613 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:28.026107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 670/1363] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:30.568616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a955d58-ce64-41fb-b18d-c98df56acd35 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:30.569212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a955d58-ce64-41fb-b18d-c98df56acd35 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:30.569212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a955d58-ce64-41fb-b18d-c98df56acd35 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:30.570595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 694/1364] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:30.576278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128329f-76df-426f-a650-35ff2d3a40b8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:30.577388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128329f-76df-426f-a650-35ff2d3a40b8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:30.578736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128329f-76df-426f-a650-35ff2d3a40b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:30.598802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7128329f-76df-426f-a650-35ff2d3a40b8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:30.600227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7128329f-76df-426f-a650-35ff2d3a40b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:30.609423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 671/1365] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:30.662435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a686b9-b993-4c8e-95ff-b256b3b4ac4e None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:30.662896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a686b9-b993-4c8e-95ff-b256b3b4ac4e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:30.663270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a686b9-b993-4c8e-95ff-b256b3b4ac4e None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:30.668814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 695/1366] 10.222.0.99 () {54 vars in 961 bytes} [Fri May 13 14:46:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:30.674577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d55f-df68-48bd-bd05-b77a93016599 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:30.674874 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d55f-df68-48bd-bd05-b77a93016599 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:30.675153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d55f-df68-48bd-bd05-b77a93016599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:30.702788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c7e4d55f-df68-48bd-bd05-b77a93016599 None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:30.704127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c7e4d55f-df68-48bd-bd05-b77a93016599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:30.713888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 672/1367] 10.222.0.99 () {58 vars in 1058 bytes} [Fri May 13 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:30.722103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a686b9-b993-4c8e-95ff-b256b3b4ac4e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:30.736599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a686b9-b993-4c8e-95ff-b256b3b4ac4e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:30.741889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa88e0-e861-4953-bc9a-c33623b595e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:30.742608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa88e0-e861-4953-bc9a-c33623b595e8 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:30.742896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa88e0-e861-4953-bc9a-c33623b595e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:30.743174 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa88e0-e861-4953-bc9a-c33623b595e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:30.751477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa88e0-e861-4953-bc9a-c33623b595e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:30.753136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa88e0-e861-4953-bc9a-c33623b595e8 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:30.762942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 696/1368] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:33.074001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6df2a-9e35-4f1c-acf2-4a66a8ae51fc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.074618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6df2a-9e35-4f1c-acf2-4a66a8ae51fc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.074618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6df2a-9e35-4f1c-acf2-4a66a8ae51fc None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.075904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 673/1369] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:33.081752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cf60-93e5-42a4-94c6-d57a44dd759b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.082206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cf60-93e5-42a4-94c6-d57a44dd759b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.082293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cf60-93e5-42a4-94c6-d57a44dd759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.100617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-24a1cf60-93e5-42a4-94c6-d57a44dd759b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:33.102281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-24a1cf60-93e5-42a4-94c6-d57a44dd759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:33.111082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 697/1370] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:33.154000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6df2a-9e35-4f1c-acf2-4a66a8ae51fc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:33.168705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6df2a-9e35-4f1c-acf2-4a66a8ae51fc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:33.174078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87ab2-a2b0-46ff-b7f2-837baebca6a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:33.174731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87ab2-a2b0-46ff-b7f2-837baebca6a9 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.175013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87ab2-a2b0-46ff-b7f2-837baebca6a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.175285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87ab2-a2b0-46ff-b7f2-837baebca6a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.184002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87ab2-a2b0-46ff-b7f2-837baebca6a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:33.185610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87ab2-a2b0-46ff-b7f2-837baebca6a9 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:33.195060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 674/1371] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:33.473184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f302e-7f8a-479d-b08c-b1eceb271a54 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.473770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f302e-7f8a-479d-b08c-b1eceb271a54 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.474222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f302e-7f8a-479d-b08c-b1eceb271a54 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.476039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 698/1372] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:33.482602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc45fd5-c23a-4b80-a8e5-161a5e3defb7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.483107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc45fd5-c23a-4b80-a8e5-161a5e3defb7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.483541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc45fd5-c23a-4b80-a8e5-161a5e3defb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.502636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ccc45fd5-c23a-4b80-a8e5-161a5e3defb7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:33.504122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ccc45fd5-c23a-4b80-a8e5-161a5e3defb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:33.518561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 675/1373] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:33.825649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956de90-9496-4af5-b5cc-af3c6990c596 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.825649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956de90-9496-4af5-b5cc-af3c6990c596 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.825649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956de90-9496-4af5-b5cc-af3c6990c596 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.829057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 699/1374] 10.222.0.99 () {54 vars in 963 bytes} [Fri May 13 14:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:33.832375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8166035-473c-4e73-8234-ef6bad0811c6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.832735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8166035-473c-4e73-8234-ef6bad0811c6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.833076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8166035-473c-4e73-8234-ef6bad0811c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.883110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d8166035-473c-4e73-8234-ef6bad0811c6 None None] MFA Rules not processed for user `e156813f50bf4f1193ecb279fad65b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:33.884544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d8166035-473c-4e73-8234-ef6bad0811c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:33.946312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 676/1375] 10.222.0.99 () {58 vars in 1060 bytes} [Fri May 13 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:33.954335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956de90-9496-4af5-b5cc-af3c6990c596 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:33.965218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956de90-9496-4af5-b5cc-af3c6990c596 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:33.968678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2b0f5-1a44-4583-8bd6-1fe3db5c7309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:33.969328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b0f5-1a44-4583-8bd6-1fe3db5c7309 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:33.969616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b0f5-1a44-4583-8bd6-1fe3db5c7309 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:33.969889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2b0f5-1a44-4583-8bd6-1fe3db5c7309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:33.979392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b0f5-1a44-4583-8bd6-1fe3db5c7309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:33.980874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2b0f5-1a44-4583-8bd6-1fe3db5c7309 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:33.990361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 700/1376] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:46:35.500618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156c8a7-bcf0-4679-b08f-ff2aeee0d1ed None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:35.501230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156c8a7-bcf0-4679-b08f-ff2aeee0d1ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:35.501230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156c8a7-bcf0-4679-b08f-ff2aeee0d1ed None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:35.502577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 677/1377] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:35.510904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d86c0-e9fa-46fc-940c-15cb8c9d86c5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:35.510904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d86c0-e9fa-46fc-940c-15cb8c9d86c5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:35.510904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d86c0-e9fa-46fc-940c-15cb8c9d86c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:35.531797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5a1d86c0-e9fa-46fc-940c-15cb8c9d86c5 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:35.533614 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5a1d86c0-e9fa-46fc-940c-15cb8c9d86c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:35.542341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 701/1378] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:35.587535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156c8a7-bcf0-4679-b08f-ff2aeee0d1ed None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:35.604370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156c8a7-bcf0-4679-b08f-ff2aeee0d1ed None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:35.611286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55c241-1828-4971-b597-b91e1692c86d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:35.612017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55c241-1828-4971-b597-b91e1692c86d service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:35.612289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55c241-1828-4971-b597-b91e1692c86d service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:35.612563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55c241-1828-4971-b597-b91e1692c86d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:35.622878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55c241-1828-4971-b597-b91e1692c86d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:35.624581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55c241-1828-4971-b597-b91e1692c86d service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:35.635842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 678/1379] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:37.913161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fb36-a32f-44b1-84da-56ff22362875 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:37.913777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fb36-a32f-44b1-84da-56ff22362875 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:37.913777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fb36-a32f-44b1-84da-56ff22362875 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:37.915088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 702/1380] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:37.921171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bfc1e-24f8-40a5-a86e-78a9a2174f7b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:37.921622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bfc1e-24f8-40a5-a86e-78a9a2174f7b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:37.921739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bfc1e-24f8-40a5-a86e-78a9a2174f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:37.940928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f97bfc1e-24f8-40a5-a86e-78a9a2174f7b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:37.942126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f97bfc1e-24f8-40a5-a86e-78a9a2174f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:37.952445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 679/1381] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:37.996516 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5fb36-a32f-44b1-84da-56ff22362875 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:38.012344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5fb36-a32f-44b1-84da-56ff22362875 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:38.018212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f5027-7f73-4b2d-b027-cb4656762421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:38.018860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f5027-7f73-4b2d-b027-cb4656762421 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:38.019145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f5027-7f73-4b2d-b027-cb4656762421 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:38.019421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f5027-7f73-4b2d-b027-cb4656762421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:38.028697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f5027-7f73-4b2d-b027-cb4656762421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:38.030296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f5027-7f73-4b2d-b027-cb4656762421 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:38.041027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 703/1382] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:40.279717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c5ff2-2185-4257-924f-6debff7d2dda None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:40.280303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c5ff2-2185-4257-924f-6debff7d2dda None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:40.280303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c5ff2-2185-4257-924f-6debff7d2dda None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:40.281529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 680/1383] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:40.287001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf9da9-5462-457b-aaad-1764dc057a09 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:40.287437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf9da9-5462-457b-aaad-1764dc057a09 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:40.287551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf9da9-5462-457b-aaad-1764dc057a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:40.305382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-82cf9da9-5462-457b-aaad-1764dc057a09 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:40.306570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-82cf9da9-5462-457b-aaad-1764dc057a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:40.315047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 704/1384] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:40.364277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c5ff2-2185-4257-924f-6debff7d2dda None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:40.379927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c5ff2-2185-4257-924f-6debff7d2dda None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:40.385930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e056081-496e-43dd-9f65-41631ba34da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:40.386596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e056081-496e-43dd-9f65-41631ba34da9 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:40.386884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e056081-496e-43dd-9f65-41631ba34da9 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:40.387163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e056081-496e-43dd-9f65-41631ba34da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:40.399895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e056081-496e-43dd-9f65-41631ba34da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:40.401850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e056081-496e-43dd-9f65-41631ba34da9 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:40.413576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 681/1385] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:42.856381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd9af-f1c0-421e-9a84-2a51295f6350 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:42.856917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd9af-f1c0-421e-9a84-2a51295f6350 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:42.857036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd9af-f1c0-421e-9a84-2a51295f6350 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:42.858907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 705/1386] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:42.864338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2d94-52bb-4a43-add8-c01054d47720 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:42.864933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2d94-52bb-4a43-add8-c01054d47720 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:42.864933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2d94-52bb-4a43-add8-c01054d47720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:42.884292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2a6f2d94-52bb-4a43-add8-c01054d47720 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:42.885570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a6f2d94-52bb-4a43-add8-c01054d47720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:42.897367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 682/1387] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:42.943429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cd9af-f1c0-421e-9a84-2a51295f6350 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:42.958693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cd9af-f1c0-421e-9a84-2a51295f6350 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:42.964585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d1e8-fc6d-4a6f-aed9-2ef14a6254fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:42.965296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d1e8-fc6d-4a6f-aed9-2ef14a6254fc service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:42.965585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d1e8-fc6d-4a6f-aed9-2ef14a6254fc service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:42.965862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d1e8-fc6d-4a6f-aed9-2ef14a6254fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:42.974406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515d1e8-fc6d-4a6f-aed9-2ef14a6254fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:42.976063 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515d1e8-fc6d-4a6f-aed9-2ef14a6254fc service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:42.986097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 706/1388] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:45.226861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0af43-4591-428e-bf7c-a0af52705869 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:45.227591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0af43-4591-428e-bf7c-a0af52705869 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:45.227591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0af43-4591-428e-bf7c-a0af52705869 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:45.228804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 683/1389] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:45.237408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd66c-c6fb-4556-9c4c-bb6d54212632 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:45.238054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd66c-c6fb-4556-9c4c-bb6d54212632 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:45.238536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd66c-c6fb-4556-9c4c-bb6d54212632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:45.261985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-258cd66c-c6fb-4556-9c4c-bb6d54212632 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:45.263788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-258cd66c-c6fb-4556-9c4c-bb6d54212632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:45.274923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 707/1390] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:45.319802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0af43-4591-428e-bf7c-a0af52705869 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:45.337581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0af43-4591-428e-bf7c-a0af52705869 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:45.343696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfd0c2-bfc9-4cbb-90ec-2e9e4d0cbaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:45.344370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfd0c2-bfc9-4cbb-90ec-2e9e4d0cbaf0 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:45.344647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfd0c2-bfc9-4cbb-90ec-2e9e4d0cbaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:45.344920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfd0c2-bfc9-4cbb-90ec-2e9e4d0cbaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:45.353824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfd0c2-bfc9-4cbb-90ec-2e9e4d0cbaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:45.355428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfd0c2-bfc9-4cbb-90ec-2e9e4d0cbaf0 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:45.365284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 684/1391] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:47.600237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0233-c455-4890-9efc-9f46d48b7a70 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:47.600844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0233-c455-4890-9efc-9f46d48b7a70 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:47.600844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0233-c455-4890-9efc-9f46d48b7a70 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:47.602228 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 708/1392] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:47.608001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598efb98-4506-41a6-9b01-d2fe6675f166 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:47.608485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598efb98-4506-41a6-9b01-d2fe6675f166 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:47.608595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598efb98-4506-41a6-9b01-d2fe6675f166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:47.626627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-598efb98-4506-41a6-9b01-d2fe6675f166 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:47.627886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-598efb98-4506-41a6-9b01-d2fe6675f166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:47.636842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 685/1393] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:47.680259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f0233-c455-4890-9efc-9f46d48b7a70 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:47.695006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f0233-c455-4890-9efc-9f46d48b7a70 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:47.701375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6be53-303d-482b-87db-de8340e34d0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:47.702037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6be53-303d-482b-87db-de8340e34d0e service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:47.702336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6be53-303d-482b-87db-de8340e34d0e service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:47.702645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6be53-303d-482b-87db-de8340e34d0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:47.711655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6be53-303d-482b-87db-de8340e34d0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:47.713291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6be53-303d-482b-87db-de8340e34d0e service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:47.723613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 709/1394] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:49.689774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e26c-39ec-4c76-886c-16ce53298052 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:49.690301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e26c-39ec-4c76-886c-16ce53298052 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:49.690301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e26c-39ec-4c76-886c-16ce53298052 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:49.691652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 686/1395] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:49.697691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2a15d-a522-41e0-8018-5cd0811adb13 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:49.697691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2a15d-a522-41e0-8018-5cd0811adb13 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:49.698454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2a15d-a522-41e0-8018-5cd0811adb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:49.717723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d1c2a15d-a522-41e0-8018-5cd0811adb13 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:49.718967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d1c2a15d-a522-41e0-8018-5cd0811adb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:49.727771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 710/1396] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:49.786396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8804f1-8f0c-4024-85d7-ef392bf6e36d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:49.786680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8804f1-8f0c-4024-85d7-ef392bf6e36d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:49.786953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8804f1-8f0c-4024-85d7-ef392bf6e36d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:49.788364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 687/1397] 10.222.0.99 () {54 vars in 962 bytes} [Fri May 13 14:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:49.795099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08718c-a6f6-4615-a17d-43faae3411e0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:49.796545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08718c-a6f6-4615-a17d-43faae3411e0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:49.796545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08718c-a6f6-4615-a17d-43faae3411e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:49.848525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-aa08718c-a6f6-4615-a17d-43faae3411e0 None None] MFA Rules not processed for user `1e1525affb11454d977ac931c4feb822`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:49.849723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aa08718c-a6f6-4615-a17d-43faae3411e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:49.913735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 711/1398] 10.222.0.99 () {58 vars in 1059 bytes} [Fri May 13 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:49.921608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8804f1-8f0c-4024-85d7-ef392bf6e36d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:49.927908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2438-af08-48b8-8777-eb65f4d19bd9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:49.928343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2438-af08-48b8-8777-eb65f4d19bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:49.928687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2438-af08-48b8-8777-eb65f4d19bd9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:49.930315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 712/1399] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:49.933131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8804f1-8f0c-4024-85d7-ef392bf6e36d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:49.935793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1a92-2668-4d36-a01c-cd78ebdbe6da None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:49.936130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1a92-2668-4d36-a01c-cd78ebdbe6da None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:49.936391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1a92-2668-4d36-a01c-cd78ebdbe6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:49.937367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:49.938068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:49.938353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:49.938643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:49.948280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:49.949770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:49.955273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a19d1a92-2668-4d36-a01c-cd78ebdbe6da None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:49.956479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a19d1a92-2668-4d36-a01c-cd78ebdbe6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:49.960334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 688/1400] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:49.965199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 713/1401] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:50.007709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:50.020267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c0312-8a07-4ae6-bf92-c10185839769 service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:50.026862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f0f6-e1a4-442d-bc06-2901e04f9238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:50.027504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f0f6-e1a4-442d-bc06-2901e04f9238 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:50.027789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f0f6-e1a4-442d-bc06-2901e04f9238 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:50.028115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f0f6-e1a4-442d-bc06-2901e04f9238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:50.036594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f0f6-e1a4-442d-bc06-2901e04f9238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:50.038286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f0f6-e1a4-442d-bc06-2901e04f9238 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:50.048041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 689/1402] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:46:50.411703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03137-6279-4a4d-bf7f-b90ab22517e6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:50.412062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03137-6279-4a4d-bf7f-b90ab22517e6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:50.412338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d03137-6279-4a4d-bf7f-b90ab22517e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:50.462239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c5d03137-6279-4a4d-bf7f-b90ab22517e6 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:50.463430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c5d03137-6279-4a4d-bf7f-b90ab22517e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:50.531007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 714/1403] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:50.576331 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fe924-cf31-4004-9d15-1010af8698b6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:50.576618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fe924-cf31-4004-9d15-1010af8698b6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:50.576892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fe924-cf31-4004-9d15-1010af8698b6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:50.578242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 690/1404] 10.222.0.99 () {54 vars in 942 bytes} [Fri May 13 14:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:50.585097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5058-1571-4e49-a0f1-93b2dd9ab11b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:50.585390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5058-1571-4e49-a0f1-93b2dd9ab11b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:50.585673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5058-1571-4e49-a0f1-93b2dd9ab11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:50.634385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4dbe5058-1571-4e49-a0f1-93b2dd9ab11b None None] MFA Rules not processed for user `6f71bb499b4e4f5cbb0caeee2d30387a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:50.635578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4dbe5058-1571-4e49-a0f1-93b2dd9ab11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:50.707534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 715/1405] 10.222.0.99 () {58 vars in 1039 bytes} [Fri May 13 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:46:50.717604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fe924-cf31-4004-9d15-1010af8698b6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:50.731600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fe924-cf31-4004-9d15-1010af8698b6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:50.737018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e53c58-e3be-4d9a-abfe-6d8cb8b3243a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:50.737662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53c58-e3be-4d9a-abfe-6d8cb8b3243a service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:50.737939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53c58-e3be-4d9a-abfe-6d8cb8b3243a service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:50.738214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53c58-e3be-4d9a-abfe-6d8cb8b3243a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:50.746197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e53c58-e3be-4d9a-abfe-6d8cb8b3243a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:50.747777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e53c58-e3be-4d9a-abfe-6d8cb8b3243a service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:50.755577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 691/1406] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 14:46:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:46:52.353205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b932df-5ad2-4d8d-a814-05a590a51bd5 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:52.353751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b932df-5ad2-4d8d-a814-05a590a51bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:52.353751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b932df-5ad2-4d8d-a814-05a590a51bd5 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:52.355364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 716/1407] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:46:52.361700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789edc8-a7d6-4710-b23f-b798e3f5e380 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:52.362202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789edc8-a7d6-4710-b23f-b798e3f5e380 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:52.362440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789edc8-a7d6-4710-b23f-b798e3f5e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:52.381003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0789edc8-a7d6-4710-b23f-b798e3f5e380 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:46:52.382493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0789edc8-a7d6-4710-b23f-b798e3f5e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:46:52.395345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 692/1408] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:46:52.440414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b932df-5ad2-4d8d-a814-05a590a51bd5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:46:52.459819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b932df-5ad2-4d8d-a814-05a590a51bd5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:46:52.465335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f708-b035-4bcf-9ded-3a94a5856ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:46:52.466006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f708-b035-4bcf-9ded-3a94a5856ec5 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:46:52.466350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f708-b035-4bcf-9ded-3a94a5856ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:46:52.467210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f708-b035-4bcf-9ded-3a94a5856ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:46:52.476583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f708-b035-4bcf-9ded-3a94a5856ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:46:52.478362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f708-b035-4bcf-9ded-3a94a5856ec5 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:46:52.489235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 717/1409] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:13.664012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc667dd-d546-41e8-ad96-ca39566c58f8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:13.664687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc667dd-d546-41e8-ad96-ca39566c58f8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:13.664687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc667dd-d546-41e8-ad96-ca39566c58f8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:13.665995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 693/1410] 10.222.0.99 () {54 vars in 918 bytes} [Fri May 13 14:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:13.671276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b39771-9d73-420f-94ee-08ec1160dd8b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:13.671751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b39771-9d73-420f-94ee-08ec1160dd8b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:13.671849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b39771-9d73-420f-94ee-08ec1160dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:13.690952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-80b39771-9d73-420f-94ee-08ec1160dd8b None None] MFA Rules not processed for user `f3b12b26b87d438c8f4eb61c8a93b31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:13.692189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-80b39771-9d73-420f-94ee-08ec1160dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:13.701876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 718/1411] 10.222.0.99 () {58 vars in 1015 bytes} [Fri May 13 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:13.717735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870b23-587f-41bc-b5e7-43867e7a164f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:13.718090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870b23-587f-41bc-b5e7-43867e7a164f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:13.718390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870b23-587f-41bc-b5e7-43867e7a164f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:13.720490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 694/1412] 10.222.0.99 () {54 vars in 918 bytes} [Fri May 13 14:47:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:13.725382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef691-e4f8-4a2b-bf85-1b720071023f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:13.725670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef691-e4f8-4a2b-bf85-1b720071023f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:13.725941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef691-e4f8-4a2b-bf85-1b720071023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:13.745098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f00ef691-e4f8-4a2b-bf85-1b720071023f None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:13.746244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f00ef691-e4f8-4a2b-bf85-1b720071023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:13.755527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 719/1413] 10.222.0.99 () {58 vars in 1015 bytes} [Fri May 13 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:47:16.463686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c579-c9ae-4ede-a5ac-ffde68f4cf1f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:16.464987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c579-c9ae-4ede-a5ac-ffde68f4cf1f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:16.464987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c579-c9ae-4ede-a5ac-ffde68f4cf1f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:16.467128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:16.473073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae86e0-abc2-4cd1-a951-f770e632c490 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:16.473568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae86e0-abc2-4cd1-a951-f770e632c490 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:16.473663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae86e0-abc2-4cd1-a951-f770e632c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:16.491502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a0ae86e0-abc2-4cd1-a951-f770e632c490 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:16.492717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a0ae86e0-abc2-4cd1-a951-f770e632c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:16.501086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:16.546254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c579-c9ae-4ede-a5ac-ffde68f4cf1f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:16.565768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c579-c9ae-4ede-a5ac-ffde68f4cf1f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:16.573479 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b391a-de28-4b3e-86f7-c90ebe7af173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:16.574336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b391a-de28-4b3e-86f7-c90ebe7af173 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:16.574721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b391a-de28-4b3e-86f7-c90ebe7af173 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:16.575058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b391a-de28-4b3e-86f7-c90ebe7af173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:16.589181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b391a-de28-4b3e-86f7-c90ebe7af173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:16.592067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b391a-de28-4b3e-86f7-c90ebe7af173 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:16.603541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 696/1416] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:17.586743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308555e-b2ea-4cf1-8aaf-55d553879bfa None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:17.587313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308555e-b2ea-4cf1-8aaf-55d553879bfa None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:17.587408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308555e-b2ea-4cf1-8aaf-55d553879bfa None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:17.589506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:17.597277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cf742-af32-400a-8a18-c58049b79a30 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:17.597674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cf742-af32-400a-8a18-c58049b79a30 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:17.597835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cf742-af32-400a-8a18-c58049b79a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:17.620454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-586cf742-af32-400a-8a18-c58049b79a30 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:17.621663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-586cf742-af32-400a-8a18-c58049b79a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:17.629733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:17.788049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308555e-b2ea-4cf1-8aaf-55d553879bfa None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:17.809626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308555e-b2ea-4cf1-8aaf-55d553879bfa None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:17.816536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758ee7b-6693-46b6-ba61-1c4a12d41c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:17.817192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ee7b-6693-46b6-ba61-1c4a12d41c0a service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:17.817486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ee7b-6693-46b6-ba61-1c4a12d41c0a service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:17.817766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ee7b-6693-46b6-ba61-1c4a12d41c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:17.826803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ee7b-6693-46b6-ba61-1c4a12d41c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:17.828442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758ee7b-6693-46b6-ba61-1c4a12d41c0a service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:17.838215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 722/1419] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:18.793666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30f7ae-6279-40a5-a686-c31bbabfee74 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:18.794522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30f7ae-6279-40a5-a686-c31bbabfee74 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:18.794522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30f7ae-6279-40a5-a686-c31bbabfee74 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:18.796696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:18.803011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769494b-1cb3-419e-9982-3c7c3d4b5b9c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:18.803767 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769494b-1cb3-419e-9982-3c7c3d4b5b9c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:18.803952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769494b-1cb3-419e-9982-3c7c3d4b5b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:18.827677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f769494b-1cb3-419e-9982-3c7c3d4b5b9c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:18.828921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f769494b-1cb3-419e-9982-3c7c3d4b5b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:18.837558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:18.990277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30f7ae-6279-40a5-a686-c31bbabfee74 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:19.012157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30f7ae-6279-40a5-a686-c31bbabfee74 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:19.018397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12e597-8ad7-4a31-8322-e578c25898aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:19.019163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12e597-8ad7-4a31-8322-e578c25898aa service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:19.019832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12e597-8ad7-4a31-8322-e578c25898aa service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:19.020151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12e597-8ad7-4a31-8322-e578c25898aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:19.028469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12e597-8ad7-4a31-8322-e578c25898aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:19.030100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12e597-8ad7-4a31-8322-e578c25898aa service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:19.039717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 699/1422] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:19.971500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a595b2-0b55-4adb-bdf4-f623ca856ed3 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:19.972512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a595b2-0b55-4adb-bdf4-f623ca856ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:19.972512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a595b2-0b55-4adb-bdf4-f623ca856ed3 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:19.974646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:19.980791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0d0f-c9a7-4563-94f6-1163d905c906 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:19.981228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0d0f-c9a7-4563-94f6-1163d905c906 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:19.981347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0d0f-c9a7-4563-94f6-1163d905c906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:20.001103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-454e0d0f-c9a7-4563-94f6-1163d905c906 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:20.002308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-454e0d0f-c9a7-4563-94f6-1163d905c906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:20.011028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:20.173551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a595b2-0b55-4adb-bdf4-f623ca856ed3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:20.196554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a595b2-0b55-4adb-bdf4-f623ca856ed3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:20.203215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e122a-18f0-4fc2-b04a-251b5f677677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:20.203852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e122a-18f0-4fc2-b04a-251b5f677677 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:20.204179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e122a-18f0-4fc2-b04a-251b5f677677 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:20.204454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e122a-18f0-4fc2-b04a-251b5f677677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:20.213868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e122a-18f0-4fc2-b04a-251b5f677677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:20.215790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e122a-18f0-4fc2-b04a-251b5f677677 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:20.225914 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 725/1425] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:21.178775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13787e-83f9-4dee-bfe0-0ecf4fe8d39a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:21.179694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13787e-83f9-4dee-bfe0-0ecf4fe8d39a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:21.179694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13787e-83f9-4dee-bfe0-0ecf4fe8d39a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:21.181872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:21.190273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919521d-03df-479b-a490-2aa18ce33a93 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:21.190994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919521d-03df-479b-a490-2aa18ce33a93 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:21.191166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919521d-03df-479b-a490-2aa18ce33a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:21.211342 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6919521d-03df-479b-a490-2aa18ce33a93 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:21.212625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6919521d-03df-479b-a490-2aa18ce33a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:21.221917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:21.372814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13787e-83f9-4dee-bfe0-0ecf4fe8d39a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:21.389383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13787e-83f9-4dee-bfe0-0ecf4fe8d39a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:21.397658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915c1c1-4325-4405-b645-4de6748d5a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:21.398668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915c1c1-4325-4405-b645-4de6748d5a6e service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:21.399145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915c1c1-4325-4405-b645-4de6748d5a6e service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:21.399675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915c1c1-4325-4405-b645-4de6748d5a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:21.414400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915c1c1-4325-4405-b645-4de6748d5a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:21.417088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915c1c1-4325-4405-b645-4de6748d5a6e service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:21.430780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 702/1428] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:22.292583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989833-bd57-47f1-a5f0-23d02a038a46 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:22.293451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989833-bd57-47f1-a5f0-23d02a038a46 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:22.293451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989833-bd57-47f1-a5f0-23d02a038a46 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:22.295620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:22.301330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9f902-ae78-4458-8532-27e4531bbbf1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:22.301330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9f902-ae78-4458-8532-27e4531bbbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:22.301857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9f902-ae78-4458-8532-27e4531bbbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:22.321148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fcb9f902-ae78-4458-8532-27e4531bbbf1 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:22.322346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fcb9f902-ae78-4458-8532-27e4531bbbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:22.333299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:22.481900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989833-bd57-47f1-a5f0-23d02a038a46 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:22.504481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989833-bd57-47f1-a5f0-23d02a038a46 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:22.510454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f2f68-c13f-46d2-9b2c-9df9d1e9a961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:22.511099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2f68-c13f-46d2-9b2c-9df9d1e9a961 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:22.511381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2f68-c13f-46d2-9b2c-9df9d1e9a961 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:22.511633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f2f68-c13f-46d2-9b2c-9df9d1e9a961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:22.520264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2f68-c13f-46d2-9b2c-9df9d1e9a961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:22.521849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f2f68-c13f-46d2-9b2c-9df9d1e9a961 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:22.531168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 728/1431] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:23.444887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867e25f-17f9-4c9d-b161-1939f72d4bc2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:23.445489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867e25f-17f9-4c9d-b161-1939f72d4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:23.445489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867e25f-17f9-4c9d-b161-1939f72d4bc2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:23.446792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:23.453026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e849-0f20-4b90-bead-a890876ab249 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:23.453764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e849-0f20-4b90-bead-a890876ab249 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:23.453941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195e849-0f20-4b90-bead-a890876ab249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:23.481716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a195e849-0f20-4b90-bead-a890876ab249 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:23.482939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a195e849-0f20-4b90-bead-a890876ab249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:23.492872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:23.647412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867e25f-17f9-4c9d-b161-1939f72d4bc2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:23.672516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867e25f-17f9-4c9d-b161-1939f72d4bc2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:23.681305 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b272-088b-4838-acc6-f2b49ef888bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:23.682272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b272-088b-4838-acc6-f2b49ef888bb service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:23.682664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b272-088b-4838-acc6-f2b49ef888bb service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:23.683071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b272-088b-4838-acc6-f2b49ef888bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:23.696855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444b272-088b-4838-acc6-f2b49ef888bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:23.699288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444b272-088b-4838-acc6-f2b49ef888bb service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:23.712358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 705/1434] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:24.592648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024ad0-2f44-4843-bc29-a5c7606a13f0 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:24.593501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024ad0-2f44-4843-bc29-a5c7606a13f0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:24.593501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024ad0-2f44-4843-bc29-a5c7606a13f0 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:24.595748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:24.602020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc36fd-cc04-4576-8217-20ca72ef0ffb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:24.602477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc36fd-cc04-4576-8217-20ca72ef0ffb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:24.602620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc36fd-cc04-4576-8217-20ca72ef0ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:24.625771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b2bc36fd-cc04-4576-8217-20ca72ef0ffb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:24.626979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2bc36fd-cc04-4576-8217-20ca72ef0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:24.638108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:24.792271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024ad0-2f44-4843-bc29-a5c7606a13f0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:24.808972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024ad0-2f44-4843-bc29-a5c7606a13f0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:24.815854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81be5-6b68-405b-b6a2-d18c6edeea9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:24.816519 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81be5-6b68-405b-b6a2-d18c6edeea9b service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:24.816801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81be5-6b68-405b-b6a2-d18c6edeea9b service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:24.817115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81be5-6b68-405b-b6a2-d18c6edeea9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:24.825403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c81be5-6b68-405b-b6a2-d18c6edeea9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:24.826993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c81be5-6b68-405b-b6a2-d18c6edeea9b service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:24.836367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 731/1437] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:25.711450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebfea1-4983-4b02-addb-b595915bc3cb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:25.712145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebfea1-4983-4b02-addb-b595915bc3cb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:25.712145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebfea1-4983-4b02-addb-b595915bc3cb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:25.713426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:25.720129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8474-5fa4-4f31-b3f7-32151521b36d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:25.720907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8474-5fa4-4f31-b3f7-32151521b36d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:25.721097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8474-5fa4-4f31-b3f7-32151521b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:25.740818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-370c8474-5fa4-4f31-b3f7-32151521b36d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:25.742044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-370c8474-5fa4-4f31-b3f7-32151521b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:25.751070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:25.900288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebfea1-4983-4b02-addb-b595915bc3cb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:25.915462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebfea1-4983-4b02-addb-b595915bc3cb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:25.921553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be7be3-5180-41bc-9cb3-13b736428fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:25.922183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be7be3-5180-41bc-9cb3-13b736428fa1 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:25.922450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be7be3-5180-41bc-9cb3-13b736428fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:25.922729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be7be3-5180-41bc-9cb3-13b736428fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:25.930997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be7be3-5180-41bc-9cb3-13b736428fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:25.932625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be7be3-5180-41bc-9cb3-13b736428fa1 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:25.941834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 708/1440] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:28.035153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344fec-619b-48e0-8eaf-620287ac7ecc None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:28.035717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344fec-619b-48e0-8eaf-620287ac7ecc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:28.035717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344fec-619b-48e0-8eaf-620287ac7ecc None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:28.037404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:28.042869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd040b-4c5c-4467-a7cf-689c83a485c0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:28.043315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd040b-4c5c-4467-a7cf-689c83a485c0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:28.043418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd040b-4c5c-4467-a7cf-689c83a485c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:28.061404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-03cd040b-4c5c-4467-a7cf-689c83a485c0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:28.062631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-03cd040b-4c5c-4467-a7cf-689c83a485c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:28.071027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:28.117027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f344fec-619b-48e0-8eaf-620287ac7ecc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:28.135811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f344fec-619b-48e0-8eaf-620287ac7ecc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:28.142786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e5360-77b0-4852-952a-c4fd8965c6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:28.143713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e5360-77b0-4852-952a-c4fd8965c6bd service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:28.144147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e5360-77b0-4852-952a-c4fd8965c6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:28.144510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e5360-77b0-4852-952a-c4fd8965c6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:28.154977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e5360-77b0-4852-952a-c4fd8965c6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:28.156472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e5360-77b0-4852-952a-c4fd8965c6bd service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:28.166218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 734/1443] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:30.527326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdde6-316b-404f-83d2-f0b691972da2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:30.527849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdde6-316b-404f-83d2-f0b691972da2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:30.527849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdde6-316b-404f-83d2-f0b691972da2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:30.529239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:30.534686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419a3d-732f-4cea-b0fe-7ffb2b901362 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:30.535105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419a3d-732f-4cea-b0fe-7ffb2b901362 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:30.535246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419a3d-732f-4cea-b0fe-7ffb2b901362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:30.562352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-64419a3d-732f-4cea-b0fe-7ffb2b901362 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:30.563576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-64419a3d-732f-4cea-b0fe-7ffb2b901362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:30.573002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:30.612461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fdde6-316b-404f-83d2-f0b691972da2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:30.625237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fdde6-316b-404f-83d2-f0b691972da2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:30.629412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c01e4-f6f3-431d-9432-0b2818574f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:30.630051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c01e4-f6f3-431d-9432-0b2818574f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:30.630338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c01e4-f6f3-431d-9432-0b2818574f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:30.630848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c01e4-f6f3-431d-9432-0b2818574f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:30.640192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c01e4-f6f3-431d-9432-0b2818574f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:30.641655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c01e4-f6f3-431d-9432-0b2818574f21 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:30.651183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 711/1446] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:33.293910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced66d7-9acd-485d-b2ee-098860db7aa2 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:33.294827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced66d7-9acd-485d-b2ee-098860db7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:33.294827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced66d7-9acd-485d-b2ee-098860db7aa2 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:33.297071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:33.303662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053d7c3-b817-4fe4-b647-feb5e4dc08cd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:33.304161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053d7c3-b817-4fe4-b647-feb5e4dc08cd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:33.304256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053d7c3-b817-4fe4-b647-feb5e4dc08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:33.324258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7053d7c3-b817-4fe4-b647-feb5e4dc08cd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:33.325474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7053d7c3-b817-4fe4-b647-feb5e4dc08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:33.334725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:33.389212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced66d7-9acd-485d-b2ee-098860db7aa2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:33.401108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced66d7-9acd-485d-b2ee-098860db7aa2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:33.405045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2a15d-ef3c-4eb5-b7fe-3ec6001f4c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:33.405682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a15d-ef3c-4eb5-b7fe-3ec6001f4c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:33.405961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a15d-ef3c-4eb5-b7fe-3ec6001f4c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:33.406236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a15d-ef3c-4eb5-b7fe-3ec6001f4c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:33.416592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2a15d-ef3c-4eb5-b7fe-3ec6001f4c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:33.418036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2a15d-ef3c-4eb5-b7fe-3ec6001f4c86 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:33.428109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 737/1449] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:35.828155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29e96-375a-4d00-b57d-2ca58d5b5fe7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:35.828690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29e96-375a-4d00-b57d-2ca58d5b5fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:35.828690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29e96-375a-4d00-b57d-2ca58d5b5fe7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:35.830081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:35.836559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc001-30a5-4ce2-9a24-6e8f9f854818 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:35.837060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc001-30a5-4ce2-9a24-6e8f9f854818 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:35.837160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc001-30a5-4ce2-9a24-6e8f9f854818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:35.864563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-277cc001-30a5-4ce2-9a24-6e8f9f854818 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:35.866254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-277cc001-30a5-4ce2-9a24-6e8f9f854818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:35.875364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:35.916187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29e96-375a-4d00-b57d-2ca58d5b5fe7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:35.928685 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29e96-375a-4d00-b57d-2ca58d5b5fe7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:35.932375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed0b53-4664-43b8-82fd-91efd06175ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:35.933020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0b53-4664-43b8-82fd-91efd06175ca service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:35.933300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0b53-4664-43b8-82fd-91efd06175ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:35.933572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed0b53-4664-43b8-82fd-91efd06175ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:35.942841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0b53-4664-43b8-82fd-91efd06175ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:35.945294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed0b53-4664-43b8-82fd-91efd06175ca service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:35.953905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 714/1452] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:38.295408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7e76-1d2d-477a-b724-ba600929e399 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:38.296404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7e76-1d2d-477a-b724-ba600929e399 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:38.296404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7e76-1d2d-477a-b724-ba600929e399 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:38.298434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:38.307472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbf5e-455b-4072-9300-91625ffe4974 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:38.308255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbf5e-455b-4072-9300-91625ffe4974 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:38.308427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cbf5e-455b-4072-9300-91625ffe4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:38.331463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3b5cbf5e-455b-4072-9300-91625ffe4974 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:38.332674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b5cbf5e-455b-4072-9300-91625ffe4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:38.341406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:38.379016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d7e76-1d2d-477a-b724-ba600929e399 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:38.391036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d7e76-1d2d-477a-b724-ba600929e399 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:38.395199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762772-1400-4cb0-b426-2c324332ea7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:38.395918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762772-1400-4cb0-b426-2c324332ea7e service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:38.396231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762772-1400-4cb0-b426-2c324332ea7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:38.396504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762772-1400-4cb0-b426-2c324332ea7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:38.406355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762772-1400-4cb0-b426-2c324332ea7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:38.407802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762772-1400-4cb0-b426-2c324332ea7e service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:38.417285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 740/1455] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:40.682162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443dbd7-987d-4b1e-8056-92ec802ee2c8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:40.682781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443dbd7-987d-4b1e-8056-92ec802ee2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:40.682781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443dbd7-987d-4b1e-8056-92ec802ee2c8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:40.684251 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:40.693449 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d6176-54b7-451f-86af-3f83b55f2d6f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:40.694172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d6176-54b7-451f-86af-3f83b55f2d6f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:40.694346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d6176-54b7-451f-86af-3f83b55f2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:40.713182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-536d6176-54b7-451f-86af-3f83b55f2d6f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:40.714383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-536d6176-54b7-451f-86af-3f83b55f2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:40.723980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:40.761723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443dbd7-987d-4b1e-8056-92ec802ee2c8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:40.778241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443dbd7-987d-4b1e-8056-92ec802ee2c8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:40.784332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfe500-1c81-4fe9-b46f-748ddaa772c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:40.785238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe500-1c81-4fe9-b46f-748ddaa772c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:40.785631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe500-1c81-4fe9-b46f-748ddaa772c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:40.785900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe500-1c81-4fe9-b46f-748ddaa772c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:40.798268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfe500-1c81-4fe9-b46f-748ddaa772c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:40.799768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfe500-1c81-4fe9-b46f-748ddaa772c1 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:40.810195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 717/1458] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:43.074832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0124-2390-4eee-af8b-6e6fcf7bbe49 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:43.075432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0124-2390-4eee-af8b-6e6fcf7bbe49 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:43.075432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0124-2390-4eee-af8b-6e6fcf7bbe49 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:43.076888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:43.083419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821befb5-e28d-4049-85f7-46b13f7c03fb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:43.084210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821befb5-e28d-4049-85f7-46b13f7c03fb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:43.084395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821befb5-e28d-4049-85f7-46b13f7c03fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:43.105843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-821befb5-e28d-4049-85f7-46b13f7c03fb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:43.107049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-821befb5-e28d-4049-85f7-46b13f7c03fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:43.117425 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:43.154593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a0124-2390-4eee-af8b-6e6fcf7bbe49 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:43.166976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a0124-2390-4eee-af8b-6e6fcf7bbe49 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:43.171365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18fd5-89e8-48b6-a39f-60269077de9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:43.172049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18fd5-89e8-48b6-a39f-60269077de9c service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:43.172340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18fd5-89e8-48b6-a39f-60269077de9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:43.172594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18fd5-89e8-48b6-a39f-60269077de9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:43.184899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c18fd5-89e8-48b6-a39f-60269077de9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:43.187240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c18fd5-89e8-48b6-a39f-60269077de9c service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:43.202979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 743/1461] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:45.475826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad463-97c5-4442-9ff3-928d99fea83f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:45.476518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad463-97c5-4442-9ff3-928d99fea83f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:45.476518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cad463-97c5-4442-9ff3-928d99fea83f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:45.478383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:45.485054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f216-b8b7-4950-8fe9-81ee39245a5d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:45.485764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f216-b8b7-4950-8fe9-81ee39245a5d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:45.485951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f216-b8b7-4950-8fe9-81ee39245a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:45.507337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8a12f216-b8b7-4950-8fe9-81ee39245a5d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:45.509019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8a12f216-b8b7-4950-8fe9-81ee39245a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:45.518355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:45.556889 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad463-97c5-4442-9ff3-928d99fea83f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:45.569334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cad463-97c5-4442-9ff3-928d99fea83f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:45.573603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8ea63-df9e-4f5d-a965-3e0d8589636b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:45.574239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ea63-df9e-4f5d-a965-3e0d8589636b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:45.574504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ea63-df9e-4f5d-a965-3e0d8589636b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:45.574778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ea63-df9e-4f5d-a965-3e0d8589636b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:45.584654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8ea63-df9e-4f5d-a965-3e0d8589636b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:45.586241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8ea63-df9e-4f5d-a965-3e0d8589636b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:45.595804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 720/1464] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:47.822948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a812e0-106e-4b5a-8fb7-ef1960520191 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:47.823604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a812e0-106e-4b5a-8fb7-ef1960520191 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:47.823604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a812e0-106e-4b5a-8fb7-ef1960520191 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:47.825922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:47.831495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c5c2f-269f-4450-9568-0f3ebd55934c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:47.831961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c5c2f-269f-4450-9568-0f3ebd55934c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:47.832158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c5c2f-269f-4450-9568-0f3ebd55934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:47.852405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-386c5c2f-269f-4450-9568-0f3ebd55934c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:47.853645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-386c5c2f-269f-4450-9568-0f3ebd55934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:47.863055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:47.903161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a812e0-106e-4b5a-8fb7-ef1960520191 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:47.919639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a812e0-106e-4b5a-8fb7-ef1960520191 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:47.924092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142be41f-0b1b-443c-9f22-d169bf5179b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:47.924734 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be41f-0b1b-443c-9f22-d169bf5179b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:47.925012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be41f-0b1b-443c-9f22-d169bf5179b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:47.925282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142be41f-0b1b-443c-9f22-d169bf5179b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:47.934448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142be41f-0b1b-443c-9f22-d169bf5179b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:47.935892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142be41f-0b1b-443c-9f22-d169bf5179b3 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:47.945055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 746/1467] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:47:50.167735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c3c0-e52e-40fd-8a6d-f643834adb32 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:50.168625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c3c0-e52e-40fd-8a6d-f643834adb32 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:50.168625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c3c0-e52e-40fd-8a6d-f643834adb32 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:50.170726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:47:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:47:50.179824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916ba5c-cd31-4eae-b91d-3878e17cf962 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:50.180316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916ba5c-cd31-4eae-b91d-3878e17cf962 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:50.181325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916ba5c-cd31-4eae-b91d-3878e17cf962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:50.202808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7916ba5c-cd31-4eae-b91d-3878e17cf962 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:47:50.204077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7916ba5c-cd31-4eae-b91d-3878e17cf962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:47:50.214279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:47:50.251642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589c3c0-e52e-40fd-8a6d-f643834adb32 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:47:50.264391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589c3c0-e52e-40fd-8a6d-f643834adb32 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:47:50.268564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b88a49-cbbd-47fa-b141-fd7eadc8ed3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:47:50.269230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b88a49-cbbd-47fa-b141-fd7eadc8ed3c service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:47:50.269500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b88a49-cbbd-47fa-b141-fd7eadc8ed3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:47:50.269799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b88a49-cbbd-47fa-b141-fd7eadc8ed3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:47:50.279720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b88a49-cbbd-47fa-b141-fd7eadc8ed3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:47:50.281227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b88a49-cbbd-47fa-b141-fd7eadc8ed3c service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:47:50.291502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 723/1470] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:48:23.170287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc448e-cb46-462d-8c37-9960f7e060f5 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:23.170926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc448e-cb46-462d-8c37-9960f7e060f5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:23.170926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc448e-cb46-462d-8c37-9960f7e060f5 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:23.172247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 748/1471] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:23.178744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23288c-559b-45fc-8c18-9ecdf0d998bd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:23.179217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23288c-559b-45fc-8c18-9ecdf0d998bd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:23.179362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23288c-559b-45fc-8c18-9ecdf0d998bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:23.205368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3d23288c-559b-45fc-8c18-9ecdf0d998bd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:23.206575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3d23288c-559b-45fc-8c18-9ecdf0d998bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:23.214848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 724/1472] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:23.270044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3c91-6e50-4cfe-a971-b0ca733709f8 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:23.270325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3c91-6e50-4cfe-a971-b0ca733709f8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:23.270601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3c91-6e50-4cfe-a971-b0ca733709f8 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:23.271997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 749/1473] 10.222.0.99 () {54 vars in 962 bytes} [Fri May 13 14:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:23.277806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d1de-9718-4ef4-a1db-bb43621eca09 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:23.278100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d1de-9718-4ef4-a1db-bb43621eca09 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:23.278395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d1de-9718-4ef4-a1db-bb43621eca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:23.303210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6747d1de-9718-4ef4-a1db-bb43621eca09 None None] MFA Rules not processed for user `1e1525affb11454d977ac931c4feb822`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:23.304435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6747d1de-9718-4ef4-a1db-bb43621eca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:23.312131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 725/1474] 10.222.0.99 () {58 vars in 1059 bytes} [Fri May 13 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:23.319328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3c91-6e50-4cfe-a971-b0ca733709f8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:23.331748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3c91-6e50-4cfe-a971-b0ca733709f8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:23.338804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d2745-9f3f-45cb-87a0-d4e3503dcce9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:23.339798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2745-9f3f-45cb-87a0-d4e3503dcce9 service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:23.340244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2745-9f3f-45cb-87a0-d4e3503dcce9 service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:23.340681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2745-9f3f-45cb-87a0-d4e3503dcce9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:23.355939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d2745-9f3f-45cb-87a0-d4e3503dcce9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:23.357918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d2745-9f3f-45cb-87a0-d4e3503dcce9 service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:23.367979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 750/1475] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:48:25.680853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2ab44-e3fc-4ff5-948c-3c058583bb27 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:25.681698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2ab44-e3fc-4ff5-948c-3c058583bb27 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:25.681698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2ab44-e3fc-4ff5-948c-3c058583bb27 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:25.683804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 726/1476] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:48:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:25.692892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cb672-3534-4182-8ac5-539fcfdf6c85 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:25.693354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cb672-3534-4182-8ac5-539fcfdf6c85 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:25.693461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cb672-3534-4182-8ac5-539fcfdf6c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:25.715173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-698cb672-3534-4182-8ac5-539fcfdf6c85 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:25.716405 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-698cb672-3534-4182-8ac5-539fcfdf6c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:25.724842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 751/1477] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:25.757492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2ab44-e3fc-4ff5-948c-3c058583bb27 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:25.770955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2ab44-e3fc-4ff5-948c-3c058583bb27 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:25.775926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfc8fb-5963-4845-8e01-155cfdb35aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:25.776600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfc8fb-5963-4845-8e01-155cfdb35aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:25.776882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfc8fb-5963-4845-8e01-155cfdb35aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:25.777162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfc8fb-5963-4845-8e01-155cfdb35aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:25.777894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfc8fb-5963-4845-8e01-155cfdb35aa5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:25.779654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-35dfc8fb-5963-4845-8e01-155cfdb35aa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:48:25.779654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:48:25.779654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:48:25.780943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfc8fb-5963-4845-8e01-155cfdb35aa5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:25.801627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 727/1478] 10.222.0.99 () {56 vars in 1108 bytes} [Fri May 13 14:48:25 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:48:28.049190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a61821-1933-47ff-b891-444ebc0ee3d5 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:28.049784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a61821-1933-47ff-b891-444ebc0ee3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:28.049784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a61821-1933-47ff-b891-444ebc0ee3d5 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:28.051158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 752/1479] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:28.057696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc82c-1992-412d-9850-7b90010fa3dd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:28.058140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc82c-1992-412d-9850-7b90010fa3dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:28.058292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc82c-1992-412d-9850-7b90010fa3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:28.079746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ea0fc82c-1992-412d-9850-7b90010fa3dd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:28.081018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ea0fc82c-1992-412d-9850-7b90010fa3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:28.090517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 728/1480] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:28.138037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a61821-1933-47ff-b891-444ebc0ee3d5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:28.153596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a61821-1933-47ff-b891-444ebc0ee3d5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:28.160232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01894d12-549b-4592-821d-9ec3ccef4b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:28.160872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894d12-549b-4592-821d-9ec3ccef4b7b service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:28.161152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894d12-549b-4592-821d-9ec3ccef4b7b service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:28.161424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894d12-549b-4592-821d-9ec3ccef4b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:28.169474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01894d12-549b-4592-821d-9ec3ccef4b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:28.171047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01894d12-549b-4592-821d-9ec3ccef4b7b service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:28.180094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 753/1481] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:48:30.568684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc3b4-934e-47bb-a756-0c3ddfb5b566 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:30.569301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc3b4-934e-47bb-a756-0c3ddfb5b566 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:30.569301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc3b4-934e-47bb-a756-0c3ddfb5b566 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:30.570607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 729/1482] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:30.577054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107634-7d43-435f-bd54-288f4bedd5bf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:30.578004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107634-7d43-435f-bd54-288f4bedd5bf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:30.578004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107634-7d43-435f-bd54-288f4bedd5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:30.603782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-57107634-7d43-435f-bd54-288f4bedd5bf None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:30.605662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-57107634-7d43-435f-bd54-288f4bedd5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:30.615851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 754/1483] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:30.655136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc3b4-934e-47bb-a756-0c3ddfb5b566 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:30.672420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc3b4-934e-47bb-a756-0c3ddfb5b566 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:30.676135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b7e6c-24f2-4865-9b50-c988d818635a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:30.676778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7e6c-24f2-4865-9b50-c988d818635a service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:30.677055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7e6c-24f2-4865-9b50-c988d818635a service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:30.677327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7e6c-24f2-4865-9b50-c988d818635a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:30.686180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b7e6c-24f2-4865-9b50-c988d818635a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:30.687805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b7e6c-24f2-4865-9b50-c988d818635a service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:30.696991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 730/1484] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:48:32.955948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57f33-47fb-420f-b389-d39ee69dd635 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:32.956796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57f33-47fb-420f-b389-d39ee69dd635 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:32.956796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57f33-47fb-420f-b389-d39ee69dd635 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:32.958562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 755/1485] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:48:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:32.967666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443c36-6020-43b6-892f-640fd95a0917 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:32.968403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443c36-6020-43b6-892f-640fd95a0917 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:32.968731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443c36-6020-43b6-892f-640fd95a0917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:32.994716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-30443c36-6020-43b6-892f-640fd95a0917 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:32.995960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30443c36-6020-43b6-892f-640fd95a0917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:33.005611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 731/1486] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:33.046857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57f33-47fb-420f-b389-d39ee69dd635 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:33.059210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57f33-47fb-420f-b389-d39ee69dd635 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:33.063714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f967b5-4027-4bf6-aa2e-0f84732a6c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:33.064392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f967b5-4027-4bf6-aa2e-0f84732a6c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:33.064678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f967b5-4027-4bf6-aa2e-0f84732a6c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:33.064958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f967b5-4027-4bf6-aa2e-0f84732a6c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:33.074868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f967b5-4027-4bf6-aa2e-0f84732a6c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:33.077236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f967b5-4027-4bf6-aa2e-0f84732a6c86 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:33.087831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 756/1487] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:48:35.386193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d791-6f15-4b98-9c98-e0a77078a1c3 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:35.387256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d791-6f15-4b98-9c98-e0a77078a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:35.387256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d791-6f15-4b98-9c98-e0a77078a1c3 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:35.389282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 732/1488] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:48:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:35.395958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805dcdd-cf9d-4e41-9465-82ebd4b4835a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:35.396420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805dcdd-cf9d-4e41-9465-82ebd4b4835a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:35.396522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805dcdd-cf9d-4e41-9465-82ebd4b4835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:35.414495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a805dcdd-cf9d-4e41-9465-82ebd4b4835a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:35.415681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a805dcdd-cf9d-4e41-9465-82ebd4b4835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:35.424324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 757/1489] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:35.469262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d791-6f15-4b98-9c98-e0a77078a1c3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:35.481330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d791-6f15-4b98-9c98-e0a77078a1c3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:35.485331 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0ab45-3860-48fb-a2d8-50678fe4ab74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:35.485984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0ab45-3860-48fb-a2d8-50678fe4ab74 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:35.486264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0ab45-3860-48fb-a2d8-50678fe4ab74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:35.486544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0ab45-3860-48fb-a2d8-50678fe4ab74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:35.496403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0ab45-3860-48fb-a2d8-50678fe4ab74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:35.497892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0ab45-3860-48fb-a2d8-50678fe4ab74 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:35.507661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 733/1490] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:48:37.894659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469d9f0-29f7-437d-b885-0c7a2f0dfd9b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:37.895181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469d9f0-29f7-437d-b885-0c7a2f0dfd9b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:37.895181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469d9f0-29f7-437d-b885-0c7a2f0dfd9b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:37.896592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 758/1491] 10.222.0.99 () {54 vars in 926 bytes} [Fri May 13 14:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:37.902995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766177-818c-42b9-a219-fd1d17e881a9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:37.903448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766177-818c-42b9-a219-fd1d17e881a9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:37.903571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766177-818c-42b9-a219-fd1d17e881a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:37.923896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-91766177-818c-42b9-a219-fd1d17e881a9 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:37.925101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-91766177-818c-42b9-a219-fd1d17e881a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:37.935021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 734/1492] 10.222.0.99 () {58 vars in 1023 bytes} [Fri May 13 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:48:37.973191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469d9f0-29f7-437d-b885-0c7a2f0dfd9b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:37.985513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469d9f0-29f7-437d-b885-0c7a2f0dfd9b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:37.989899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b07276-7222-4ff5-963a-40871f671d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:37.990547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07276-7222-4ff5-963a-40871f671d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:37.990823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07276-7222-4ff5-963a-40871f671d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:37.991092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07276-7222-4ff5-963a-40871f671d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:38.001572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b07276-7222-4ff5-963a-40871f671d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:38.002997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b07276-7222-4ff5-963a-40871f671d4f service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:38.012316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 759/1493] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:50:06.005548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33ddc-f784-4c6c-bde9-aef3a5f3f106 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.006172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33ddc-f784-4c6c-bde9-aef3a5f3f106 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.006172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33ddc-f784-4c6c-bde9-aef3a5f3f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.031537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3ae33ddc-f784-4c6c-bde9-aef3a5f3f106 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:06.032814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3ae33ddc-f784-4c6c-bde9-aef3a5f3f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:06.042554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 735/1494] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:50:06.052231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021b43-cc10-4044-9534-1af9596b33a8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.052786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021b43-cc10-4044-9534-1af9596b33a8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.052889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021b43-cc10-4044-9534-1af9596b33a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.071900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-05021b43-cc10-4044-9534-1af9596b33a8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:06.073097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-05021b43-cc10-4044-9534-1af9596b33a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:06.082346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 760/1495] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:50:06.088801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33ddc-f784-4c6c-bde9-aef3a5f3f106 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.103647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33ddc-f784-4c6c-bde9-aef3a5f3f106 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.110074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.110733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.111081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.111446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.112326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:06.112892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.114074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:06.114074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:50:06.114074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:50:06.114969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.127038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 736/1496] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:06.135561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021b43-cc10-4044-9534-1af9596b33a8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.145207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021b43-cc10-4044-9534-1af9596b33a8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.151653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.152248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.152524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.152794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.153482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.155234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:06.155234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 13 14:50:06.155234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: May 13 14:50:06.156462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.196551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 761/1497] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:50:06 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:06.200840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.210889 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794623e-cc96-468c-95f3-9422df1ac2bc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.276611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.277560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.277926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.278293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.279292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.280836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:06.280836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:50:06.280836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:50:06.283142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.308466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 737/1498] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:50:06 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:06.312869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.323484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1fb4b-63c9-485a-8ad7-e547f5bbb9e2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.329095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.329755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.330037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.330307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.331047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.332127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:06.332127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 13 14:50:06.332127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: May 13 14:50:06.333011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.348964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 762/1499] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:50:06.353379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.364446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea720f52-33bb-433b-afb6-1b1dec492690 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.370047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f64a1e-d5ff-471d-a0fd-4b5c3d2a43cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.370705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f64a1e-d5ff-471d-a0fd-4b5c3d2a43cb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.370986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f64a1e-d5ff-471d-a0fd-4b5c3d2a43cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.371268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f64a1e-d5ff-471d-a0fd-4b5c3d2a43cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.372043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f64a1e-d5ff-471d-a0fd-4b5c3d2a43cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.373061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-a7f64a1e-d5ff-471d-a0fd-4b5c3d2a43cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:06.373061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:50:06.373061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:50:06.373945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f64a1e-d5ff-471d-a0fd-4b5c3d2a43cb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.387884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 738/1500] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:50:06.394031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.408245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2d10c-f910-4d04-9a51-418aa0dc6b98 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.413792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86891346-22de-4089-9982-918c20054053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.414670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891346-22de-4089-9982-918c20054053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.414954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891346-22de-4089-9982-918c20054053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.415225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891346-22de-4089-9982-918c20054053 admin admin] PATH_INFO: `/v3/projects/892b4f1f03de44bbafbcd2e61f8255f9/users/87327f1dc1c04abe8fbad436eef8a941/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.430494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86891346-22de-4089-9982-918c20054053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892b4f1f03de44bbafbcd2e61f8255f9, user_id=87327f1dc1c04abe8fbad436eef8a941, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.431529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-86891346-22de-4089-9982-918c20054053 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:06.431529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 13 14:50:06.431529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: May 13 14:50:06.433536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86891346-22de-4089-9982-918c20054053 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.449547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 763/1501] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:50:06 2022] PUT /identity/v3/projects/892b4f1f03de44bbafbcd2e61f8255f9/users/87327f1dc1c04abe8fbad436eef8a941/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:06.461731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6e00-6b94-44d2-b023-950d4106daae None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.462024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6e00-6b94-44d2-b023-950d4106daae None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.462307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6e00-6b94-44d2-b023-950d4106daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.495658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2bba6e00-6b94-44d2-b023-950d4106daae None None] MFA Rules not processed for user `87327f1dc1c04abe8fbad436eef8a941`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:06.496923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2bba6e00-6b94-44d2-b023-950d4106daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:06.565234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 739/1502] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:50:06.579099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f54d-698e-47c8-8a9c-6ea9ef2ae918 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.579333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f54d-698e-47c8-8a9c-6ea9ef2ae918 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.579608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f54d-698e-47c8-8a9c-6ea9ef2ae918 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.581028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 764/1503] 10.222.0.99 () {54 vars in 963 bytes} [Fri May 13 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:06.586355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aba5f-e34e-44ba-951d-e829cfd8ef7e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.586648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aba5f-e34e-44ba-951d-e829cfd8ef7e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.586924 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aba5f-e34e-44ba-951d-e829cfd8ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.607126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b14aba5f-e34e-44ba-951d-e829cfd8ef7e None None] MFA Rules not processed for user `e156813f50bf4f1193ecb279fad65b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:06.608346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b14aba5f-e34e-44ba-951d-e829cfd8ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:06.665627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 740/1504] 10.222.0.99 () {58 vars in 1060 bytes} [Fri May 13 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:50:06.673611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26f54d-698e-47c8-8a9c-6ea9ef2ae918 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.685731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26f54d-698e-47c8-8a9c-6ea9ef2ae918 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.690050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.690720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.690960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.691234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.699772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.701234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.710051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 765/1505] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:50:06.753171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ba68-9139-4b83-9669-254193b0399e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.753457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ba68-9139-4b83-9669-254193b0399e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.753735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ba68-9139-4b83-9669-254193b0399e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.755028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 741/1506] 10.222.0.99 () {52 vars in 829 bytes} [Fri May 13 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:06.759089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.832336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82685639-0e22-4ce0-a993-069e39557c3c service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.838097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.838982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.839262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.839589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] PATH_INFO: `/v3/users/87327f1dc1c04abe8fbad436eef8a941` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.841007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87327f1dc1c04abe8fbad436eef8a941)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.842074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:06.842074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 13 14:50:06.842074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: May 13 14:50:06.843317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.914971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87327f1dc1c04abe8fbad436eef8a941'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:06.927625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87327f1dc1c04abe8fbad436eef8a941'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:06.946426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87327f1dc1c04abe8fbad436eef8a941'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:06.958847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87327f1dc1c04abe8fbad436eef8a941'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:06.959646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87327f1dc1c04abe8fbad436eef8a941'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:06.966556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 766/1507] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:50:06 2022] DELETE /identity/v3/users/87327f1dc1c04abe8fbad436eef8a941 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:06.971180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.971477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.971898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.993349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:06.994581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:07.055884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 742/1508] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:50:07.067139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:07.068764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:07.127095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba8347-60a6-4af7-8ab0-a8ae832c4d31 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:07.131897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee2766-d1f3-4d43-a5e4-2df1c1a08a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:07.132575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2766-d1f3-4d43-a5e4-2df1c1a08a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:07.132859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2766-d1f3-4d43-a5e4-2df1c1a08a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:07.133148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2766-d1f3-4d43-a5e4-2df1c1a08a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:07.142565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee2766-d1f3-4d43-a5e4-2df1c1a08a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:07.144167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee2766-d1f3-4d43-a5e4-2df1c1a08a00 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:07.157202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 767/1509] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:50:07.507465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:07.509138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:07.521942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60826eac-a8de-4d8b-87b2-5d089cd1e801 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:07.528393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:07.529338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:07.529615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:07.529890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] PATH_INFO: `/v3/projects/892b4f1f03de44bbafbcd2e61f8255f9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:07.531259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=892b4f1f03de44bbafbcd2e61f8255f9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:07.532426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:50:07.532426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:50:07.532426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:50:07.533825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:07.597046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892b4f1f03de44bbafbcd2e61f8255f9', 'request_id': 'req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:07.610351 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892b4f1f03de44bbafbcd2e61f8255f9', 'request_id': 'req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:07.622769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892b4f1f03de44bbafbcd2e61f8255f9', 'request_id': 'req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:07.633931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] The token cache is being invalidate because project 892b4f1f03de44bbafbcd2e61f8255f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:50:07.634214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:07.634833 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30b4d030-2a4b-4a19-a10e-8ed85ef7f9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:50:07.636520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 743/1510] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:50:07 2022] DELETE /identity/v3/projects/892b4f1f03de44bbafbcd2e61f8255f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:51:53.798074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fffaf-1d30-4dca-aecc-7a9c7e2bbecd None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:53.798718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fffaf-1d30-4dca-aecc-7a9c7e2bbecd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:53.798718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fffaf-1d30-4dca-aecc-7a9c7e2bbecd None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:53.800287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:53.806006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a941-ea12-46ac-83bf-becc26503845 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:53.806503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a941-ea12-46ac-83bf-becc26503845 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:53.806612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a941-ea12-46ac-83bf-becc26503845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:53.825312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a2c3a941-ea12-46ac-83bf-becc26503845 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:53.826551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2c3a941-ea12-46ac-83bf-becc26503845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:53.889457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:51:54.060536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fffaf-1d30-4dca-aecc-7a9c7e2bbecd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:54.062484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-959fffaf-1d30-4dca-aecc-7a9c7e2bbecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:54.141763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fffaf-1d30-4dca-aecc-7a9c7e2bbecd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:54.148068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaffa82-0bb8-4f2c-a47a-a4d5216d0a87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:54.148724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaffa82-0bb8-4f2c-a47a-a4d5216d0a87 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:54.149007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaffa82-0bb8-4f2c-a47a-a4d5216d0a87 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:54.149283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaffa82-0bb8-4f2c-a47a-a4d5216d0a87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:54.158563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaffa82-0bb8-4f2c-a47a-a4d5216d0a87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:54.160190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaffa82-0bb8-4f2c-a47a-a4d5216d0a87 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:54.170144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 769/1513] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:51:55.039187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0bdd6-da5a-4912-8e06-5792a10c0612 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.039791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0bdd6-da5a-4912-8e06-5792a10c0612 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.039791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0bdd6-da5a-4912-8e06-5792a10c0612 None None] PATH_INFO: `/v3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.041420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 745/1514] 10.222.0.104 () {54 vars in 926 bytes} [Fri May 13 14:51:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:55.047992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2730df-4884-45b2-854d-94dc55b5d6e8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.048454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2730df-4884-45b2-854d-94dc55b5d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.048688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2730df-4884-45b2-854d-94dc55b5d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.067564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ce2730df-4884-45b2-854d-94dc55b5d6e8 None None] MFA Rules not processed for user `f3b12b26b87d438c8f4eb61c8a93b31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:55.068783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ce2730df-4884-45b2-854d-94dc55b5d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:55.091551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31333-cc1c-4010-85a3-2accbfcb0883 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.091921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31333-cc1c-4010-85a3-2accbfcb0883 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.092630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31333-cc1c-4010-85a3-2accbfcb0883 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.094013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 746/1515] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:55.098783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98009947-0638-42bc-a0ee-6cfd7ae84165 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.099155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98009947-0638-42bc-a0ee-6cfd7ae84165 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.099492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98009947-0638-42bc-a0ee-6cfd7ae84165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.117701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-98009947-0638-42bc-a0ee-6cfd7ae84165 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:55.118901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-98009947-0638-42bc-a0ee-6cfd7ae84165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:55.127003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 747/1516] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:51:55.130535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 770/1517] 10.222.0.104 () {58 vars in 1016 bytes} [Fri May 13 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:51:55.278599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98009947-0638-42bc-a0ee-6cfd7ae84165 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:55.298428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98009947-0638-42bc-a0ee-6cfd7ae84165 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:55.304855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d834-d0d0-4e58-a814-4b84f5edd422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:55.305495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d834-d0d0-4e58-a814-4b84f5edd422 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.305773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d834-d0d0-4e58-a814-4b84f5edd422 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.306271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d834-d0d0-4e58-a814-4b84f5edd422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.315005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d834-d0d0-4e58-a814-4b84f5edd422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:55.316662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d834-d0d0-4e58-a814-4b84f5edd422 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:55.326301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 748/1518] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:52:04.560096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde90c9-da42-4608-89f9-bc176e5a4384 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:04.560655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde90c9-da42-4608-89f9-bc176e5a4384 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:04.560655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde90c9-da42-4608-89f9-bc176e5a4384 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:04.562015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 771/1519] 10.222.0.99 () {54 vars in 960 bytes} [Fri May 13 14:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:04.568417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b827ef-7b7c-4499-9fbd-3f004a464dd0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:04.569374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b827ef-7b7c-4499-9fbd-3f004a464dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:04.569374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b827ef-7b7c-4499-9fbd-3f004a464dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:04.598318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a2b827ef-7b7c-4499-9fbd-3f004a464dd0 None None] MFA Rules not processed for user `f3b12b26b87d438c8f4eb61c8a93b31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:04.599546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2b827ef-7b7c-4499-9fbd-3f004a464dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:04.609964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 749/1520] 10.222.0.99 () {58 vars in 1057 bytes} [Fri May 13 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:52:04.619128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde90c9-da42-4608-89f9-bc176e5a4384 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:04.635273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde90c9-da42-4608-89f9-bc176e5a4384 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:04.641274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff592ff3-95db-4675-90ae-2bd51fa18810 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:04.641918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff592ff3-95db-4675-90ae-2bd51fa18810 service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:04.642205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff592ff3-95db-4675-90ae-2bd51fa18810 service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:04.642483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff592ff3-95db-4675-90ae-2bd51fa18810 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:04.651050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff592ff3-95db-4675-90ae-2bd51fa18810 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:04.652690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff592ff3-95db-4675-90ae-2bd51fa18810 service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:04.662325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 772/1521] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:52:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:52:06.652118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200883-f0ff-4e67-a5e8-e4c97894c356 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:06.652709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200883-f0ff-4e67-a5e8-e4c97894c356 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:06.652709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200883-f0ff-4e67-a5e8-e4c97894c356 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:06.654800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:52:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:06.662618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423dfaa-d486-4d79-ad08-4d985af2e16e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:06.663054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423dfaa-d486-4d79-ad08-4d985af2e16e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:06.663238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423dfaa-d486-4d79-ad08-4d985af2e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:06.693765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2423dfaa-d486-4d79-ad08-4d985af2e16e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:06.694983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2423dfaa-d486-4d79-ad08-4d985af2e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:06.704641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:52:06.853966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a200883-f0ff-4e67-a5e8-e4c97894c356 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:06.870073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a200883-f0ff-4e67-a5e8-e4c97894c356 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:06.875518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb0a1-801c-451a-8f53-88c04b3f9469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:06.876212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb0a1-801c-451a-8f53-88c04b3f9469 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:06.876499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb0a1-801c-451a-8f53-88c04b3f9469 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:06.876777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb0a1-801c-451a-8f53-88c04b3f9469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:06.887163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eb0a1-801c-451a-8f53-88c04b3f9469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:06.889842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eb0a1-801c-451a-8f53-88c04b3f9469 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:06.901260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 751/1524] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:52:07.791447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45b27-3356-4600-847b-424cc0ef6979 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:07.792041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45b27-3356-4600-847b-424cc0ef6979 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:07.792041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45b27-3356-4600-847b-424cc0ef6979 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:07.793324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:07.799389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc273c4-9acf-4cd7-bb45-105b27bb9ae4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:07.800237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc273c4-9acf-4cd7-bb45-105b27bb9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:07.800335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc273c4-9acf-4cd7-bb45-105b27bb9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:07.819914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dbc273c4-9acf-4cd7-bb45-105b27bb9ae4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:07.821112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dbc273c4-9acf-4cd7-bb45-105b27bb9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:07.831418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:52:07.985995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45b27-3356-4600-847b-424cc0ef6979 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:08.008218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45b27-3356-4600-847b-424cc0ef6979 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:08.014708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37ac95-027c-4319-933e-40e8d6ff64f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:08.015347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ac95-027c-4319-933e-40e8d6ff64f6 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:08.015627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ac95-027c-4319-933e-40e8d6ff64f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:08.015910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ac95-027c-4319-933e-40e8d6ff64f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:08.024696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37ac95-027c-4319-933e-40e8d6ff64f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:08.026285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37ac95-027c-4319-933e-40e8d6ff64f6 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:08.035893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 775/1527] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:52:12.066294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770638f-4c6a-4fda-8c6d-9723d846ab99 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:12.066887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770638f-4c6a-4fda-8c6d-9723d846ab99 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:12.067032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770638f-4c6a-4fda-8c6d-9723d846ab99 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:12.068955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:12.074836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ec3dd-badf-4317-b8d0-c404456b7919 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:12.075286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ec3dd-badf-4317-b8d0-c404456b7919 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:12.075403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ec3dd-badf-4317-b8d0-c404456b7919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:12.096783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b66ec3dd-badf-4317-b8d0-c404456b7919 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:12.098006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b66ec3dd-badf-4317-b8d0-c404456b7919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:12.107190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:52:12.143733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770638f-4c6a-4fda-8c6d-9723d846ab99 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:12.145829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2770638f-4c6a-4fda-8c6d-9723d846ab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:12.205008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770638f-4c6a-4fda-8c6d-9723d846ab99 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:12.209456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0c906-94a1-4ad0-92d9-ce1146da2284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:12.210117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c906-94a1-4ad0-92d9-ce1146da2284 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:12.210407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c906-94a1-4ad0-92d9-ce1146da2284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:12.210718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c906-94a1-4ad0-92d9-ce1146da2284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:12.220770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0c906-94a1-4ad0-92d9-ce1146da2284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:12.222285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0c906-94a1-4ad0-92d9-ce1146da2284 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:12.236525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 754/1530] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:52:14.487300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7a842-7dcb-4001-82e1-dc2158dfb07d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:14.487859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7a842-7dcb-4001-82e1-dc2158dfb07d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:14.487859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7a842-7dcb-4001-82e1-dc2158dfb07d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:14.489939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:52:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:14.496340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e226c-5a91-48dd-a227-2ba419195af5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:14.496812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e226c-5a91-48dd-a227-2ba419195af5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:14.496906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e226c-5a91-48dd-a227-2ba419195af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:14.523658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-856e226c-5a91-48dd-a227-2ba419195af5 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:14.524931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-856e226c-5a91-48dd-a227-2ba419195af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:14.534027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:52:14.569882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7a842-7dcb-4001-82e1-dc2158dfb07d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:14.572137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-67b7a842-7dcb-4001-82e1-dc2158dfb07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:14.587716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7a842-7dcb-4001-82e1-dc2158dfb07d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:14.592428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34955a81-55b3-4e3b-bde3-c5c1a19c38ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:14.593083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955a81-55b3-4e3b-bde3-c5c1a19c38ca service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:14.593366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955a81-55b3-4e3b-bde3-c5c1a19c38ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:14.593638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955a81-55b3-4e3b-bde3-c5c1a19c38ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:14.603955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955a81-55b3-4e3b-bde3-c5c1a19c38ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:14.605725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955a81-55b3-4e3b-bde3-c5c1a19c38ca service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:14.615955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 778/1533] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:52:18.601354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b25c1-cd1a-43d2-b6ef-9cb7dcd31432 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.601967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b25c1-cd1a-43d2-b6ef-9cb7dcd31432 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.601967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b25c1-cd1a-43d2-b6ef-9cb7dcd31432 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.603362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:18.609303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1de45-fcdb-419b-bc08-33f0e00d9732 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.609748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1de45-fcdb-419b-bc08-33f0e00d9732 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.609849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1de45-fcdb-419b-bc08-33f0e00d9732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.628612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ccb1de45-fcdb-419b-bc08-33f0e00d9732 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:18.629806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ccb1de45-fcdb-419b-bc08-33f0e00d9732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:18.638373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:52:18.914576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b25c1-cd1a-43d2-b6ef-9cb7dcd31432 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:18.917904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-321b25c1-cd1a-43d2-b6ef-9cb7dcd31432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:18.982758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b25c1-cd1a-43d2-b6ef-9cb7dcd31432 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:18.986732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54272b4c-6eb1-4117-bb25-ab33256daded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:18.987382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54272b4c-6eb1-4117-bb25-ab33256daded service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.987666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54272b4c-6eb1-4117-bb25-ab33256daded service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.987982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54272b4c-6eb1-4117-bb25-ab33256daded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.997987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54272b4c-6eb1-4117-bb25-ab33256daded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:18.999466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54272b4c-6eb1-4117-bb25-ab33256daded service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:19.010093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 757/1536] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:52:21.267948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9f8f-b2fd-4ca8-8d39-63abce7a6501 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:21.268882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9f8f-b2fd-4ca8-8d39-63abce7a6501 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:21.268882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9f8f-b2fd-4ca8-8d39-63abce7a6501 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:21.271062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:52:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:21.276763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2c87-4514-44c5-8308-c08e677a5797 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:21.277238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2c87-4514-44c5-8308-c08e677a5797 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:21.277339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f2c87-4514-44c5-8308-c08e677a5797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:21.297378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-389f2c87-4514-44c5-8308-c08e677a5797 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:21.298556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-389f2c87-4514-44c5-8308-c08e677a5797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:21.307469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:52:21.575549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9f8f-b2fd-4ca8-8d39-63abce7a6501 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:21.577403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-62ec9f8f-b2fd-4ca8-8d39-63abce7a6501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:21.592098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9f8f-b2fd-4ca8-8d39-63abce7a6501 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:21.596719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc8d0c-32ca-4de6-94f2-779e053e05dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:21.597370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc8d0c-32ca-4de6-94f2-779e053e05dc service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:21.597652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc8d0c-32ca-4de6-94f2-779e053e05dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:21.597922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc8d0c-32ca-4de6-94f2-779e053e05dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:21.608281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc8d0c-32ca-4de6-94f2-779e053e05dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:21.609731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc8d0c-32ca-4de6-94f2-779e053e05dc service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:21.619257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 781/1539] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:53:55.111366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9e227-6be8-47a0-bb68-4e682509c655 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.112150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9e227-6be8-47a0-bb68-4e682509c655 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.112150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9e227-6be8-47a0-bb68-4e682509c655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.146544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c7f9e227-6be8-47a0-bb68-4e682509c655 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.147781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c7f9e227-6be8-47a0-bb68-4e682509c655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.160856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 759/1540] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:55.171461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5cfb-33ae-45b2-a835-89cf7154d2c2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.172635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5cfb-33ae-45b2-a835-89cf7154d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.173153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5cfb-33ae-45b2-a835-89cf7154d2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.213145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ba5f5cfb-33ae-45b2-a835-89cf7154d2c2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.215947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ba5f5cfb-33ae-45b2-a835-89cf7154d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.225559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 782/1541] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:55.230043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9e227-6be8-47a0-bb68-4e682509c655 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.242888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9e227-6be8-47a0-bb68-4e682509c655 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.253145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840e43b-d84e-4e44-895b-e6bebc9cd7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.253970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e43b-d84e-4e44-895b-e6bebc9cd7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.254268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e43b-d84e-4e44-895b-e6bebc9cd7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.254540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840e43b-d84e-4e44-895b-e6bebc9cd7c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.255279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840e43b-d84e-4e44-895b-e6bebc9cd7c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:55.255586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840e43b-d84e-4e44-895b-e6bebc9cd7c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.257263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840e43b-d84e-4e44-895b-e6bebc9cd7c2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.274559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 760/1542] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:55.282763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5cfb-33ae-45b2-a835-89cf7154d2c2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.302234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5cfb-33ae-45b2-a835-89cf7154d2c2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.308832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.309806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.310305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.310792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.311718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.314281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.337087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8015-baf7-4b14-9e8a-ffaae6c22aa7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.337400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8015-baf7-4b14-9e8a-ffaae6c22aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.337633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8015-baf7-4b14-9e8a-ffaae6c22aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.358877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 783/1543] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:55.364430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.376546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a35a8015-baf7-4b14-9e8a-ffaae6c22aa7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.380554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a35a8015-baf7-4b14-9e8a-ffaae6c22aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.549001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ba46c-25c3-46ba-a13a-d2ddba348364 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.568230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce92ad-084b-4077-993c-92744abacc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.569370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce92ad-084b-4077-993c-92744abacc76 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.570000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce92ad-084b-4077-993c-92744abacc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.571124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce92ad-084b-4077-993c-92744abacc76 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.572073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce92ad-084b-4077-993c-92744abacc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.573662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-55ce92ad-084b-4077-993c-92744abacc76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:53:55.573662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 13 14:53:55.573662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: May 13 14:53:55.575288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce92ad-084b-4077-993c-92744abacc76 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.625972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 784/1544] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:55.628545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213790d3-a857-4fc4-8e20-33f9cc09734a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.629697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213790d3-a857-4fc4-8e20-33f9cc09734a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.630241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213790d3-a857-4fc4-8e20-33f9cc09734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.635929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 761/1545] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 13 14:53:55.635929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8015-baf7-4b14-9e8a-ffaae6c22aa7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.662261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8015-baf7-4b14-9e8a-ffaae6c22aa7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.663695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-213790d3-a857-4fc4-8e20-33f9cc09734a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.665183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-213790d3-a857-4fc4-8e20-33f9cc09734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.678648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 785/1546] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:55.680431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709d6f2-b336-41b3-ac32-efc59c5239e7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.680567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dea58b-835a-44b6-8aa0-68751b2520b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.681104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709d6f2-b336-41b3-ac32-efc59c5239e7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.681232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea58b-835a-44b6-8aa0-68751b2520b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.681421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea58b-835a-44b6-8aa0-68751b2520b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.681693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea58b-835a-44b6-8aa0-68751b2520b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.682109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709d6f2-b336-41b3-ac32-efc59c5239e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.682497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dea58b-835a-44b6-8aa0-68751b2520b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.685438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dea58b-835a-44b6-8aa0-68751b2520b3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.706439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 762/1547] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:55.707950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8eef-23f7-4eb2-8c16-25d5d1628410 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.708243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8eef-23f7-4eb2-8c16-25d5d1628410 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.708520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe8eef-23f7-4eb2-8c16-25d5d1628410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.712634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b709d6f2-b336-41b3-ac32-efc59c5239e7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.714754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b709d6f2-b336-41b3-ac32-efc59c5239e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.747917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 786/1548] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:55.747917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709d6f2-b336-41b3-ac32-efc59c5239e7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.751761 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1dbe8eef-23f7-4eb2-8c16-25d5d1628410 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.753496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1dbe8eef-23f7-4eb2-8c16-25d5d1628410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.768599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 763/1549] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:55.770306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe8eef-23f7-4eb2-8c16-25d5d1628410 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.770928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709d6f2-b336-41b3-ac32-efc59c5239e7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.787153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe8eef-23f7-4eb2-8c16-25d5d1628410 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.788344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.791229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.791229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.791229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.791229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.792370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.797272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.798314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.798878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.799443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.800439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:55.800969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.803448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.823046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 787/1550] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:55.824137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.827616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 764/1551] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:55.835516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.842334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534480-6fc0-407b-96b9-b36b98309215 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.851343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afa7da-474d-477b-8a40-6ea2d7f08fc3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.855755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.856513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.856796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.859894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.859894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:55.859894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.859894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:53:55.859894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 13 14:53:55.859894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: May 13 14:53:55.860452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c31c7-5a94-495c-b4de-04ba383dd165 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.875554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 788/1552] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:55.881524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34b4e9-5e9b-4111-80ac-0126ef40b082 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.881857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34b4e9-5e9b-4111-80ac-0126ef40b082 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.882080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34b4e9-5e9b-4111-80ac-0126ef40b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.884255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fb53b-af99-4ecc-9069-33bca1eacc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.885184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb53b-af99-4ecc-9069-33bca1eacc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.885461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb53b-af99-4ecc-9069-33bca1eacc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.885736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb53b-af99-4ecc-9069-33bca1eacc5e admin admin] PATH_INFO: `/v3/projects/9d31191dfc694e3b94a6139dd2e9653f/users/ac89928ac188406d910838be33a61c3e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.905501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ff34b4e9-5e9b-4111-80ac-0126ef40b082 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.906279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ff34b4e9-5e9b-4111-80ac-0126ef40b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.918694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 789/1553] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:55.920904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34b4e9-5e9b-4111-80ac-0126ef40b082 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.929657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34b4e9-5e9b-4111-80ac-0126ef40b082 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.934862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fb53b-af99-4ecc-9069-33bca1eacc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d31191dfc694e3b94a6139dd2e9653f, user_id=ac89928ac188406d910838be33a61c3e, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.936225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.936501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-c46fb53b-af99-4ecc-9069-33bca1eacc5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:53:55.936501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:53:55.936501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:53:55.937372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.937913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.938430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.939417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.939950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fb53b-af99-4ecc-9069-33bca1eacc5e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.941385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.958361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 765/1554] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:55 2022] PUT /identity/v3/projects/9d31191dfc694e3b94a6139dd2e9653f/users/ac89928ac188406d910838be33a61c3e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:55.960138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fba99-75c4-409e-8118-2234d868165f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.960600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fba99-75c4-409e-8118-2234d868165f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.961021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fba99-75c4-409e-8118-2234d868165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.985671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f02fba99-75c4-409e-8118-2234d868165f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.987466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f02fba99-75c4-409e-8118-2234d868165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.995323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 790/1555] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:55.996308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.056915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 766/1556] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.058270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7afe0c-a4a5-47d9-922e-3a1b2252c5b8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.058559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7afe0c-a4a5-47d9-922e-3a1b2252c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.058836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7afe0c-a4a5-47d9-922e-3a1b2252c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.062000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a92562-59fe-4101-b521-fe89503999bd admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.066891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef036d-7d64-4a53-837a-35d27e723bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.067573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef036d-7d64-4a53-837a-35d27e723bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.067856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef036d-7d64-4a53-837a-35d27e723bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.068164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef036d-7d64-4a53-837a-35d27e723bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.068899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef036d-7d64-4a53-837a-35d27e723bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.070823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef036d-7d64-4a53-837a-35d27e723bd0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.078217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2e7afe0c-a4a5-47d9-922e-3a1b2252c5b8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.079503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2e7afe0c-a4a5-47d9-922e-3a1b2252c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.087954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 767/1557] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.089357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09d42-e5b6-4596-a491-8b75f0045f52 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.089645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09d42-e5b6-4596-a491-8b75f0045f52 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.090054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09d42-e5b6-4596-a491-8b75f0045f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.101278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 791/1558] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.102457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6748e4-4a77-440a-9d01-97fb7c67df78 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.102748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6748e4-4a77-440a-9d01-97fb7c67df78 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.103027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6748e4-4a77-440a-9d01-97fb7c67df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.114662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7cf09d42-e5b6-4596-a491-8b75f0045f52 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.115964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7cf09d42-e5b6-4596-a491-8b75f0045f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.120416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0a6748e4-4a77-440a-9d01-97fb7c67df78 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.121579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0a6748e4-4a77-440a-9d01-97fb7c67df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.172235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 768/1559] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.173564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d3d-51c2-4848-844d-8f2e5fd58fa7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.173852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d3d-51c2-4848-844d-8f2e5fd58fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.174125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d3d-51c2-4848-844d-8f2e5fd58fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.182778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 792/1560] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.183709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6748e4-4a77-440a-9d01-97fb7c67df78 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.193582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6748e4-4a77-440a-9d01-97fb7c67df78 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.196915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0b976d3d-51c2-4848-844d-8f2e5fd58fa7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.198133 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0b976d3d-51c2-4848-844d-8f2e5fd58fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.198275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52921a-1de6-44fd-9177-04b7a7398172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.198877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52921a-1de6-44fd-9177-04b7a7398172 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.199161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52921a-1de6-44fd-9177-04b7a7398172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.199437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52921a-1de6-44fd-9177-04b7a7398172 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.200252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52921a-1de6-44fd-9177-04b7a7398172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.202193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52921a-1de6-44fd-9177-04b7a7398172 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.206365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 769/1561] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.207593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec6c3-b546-41a2-9443-c95151f05d02 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.207911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec6c3-b546-41a2-9443-c95151f05d02 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.208200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec6c3-b546-41a2-9443-c95151f05d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.225845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 793/1562] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.227280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821266e-0bb1-4eb1-a063-8e0c1628fb0b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.227569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821266e-0bb1-4eb1-a063-8e0c1628fb0b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.227902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821266e-0bb1-4eb1-a063-8e0c1628fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.231294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-92dec6c3-b546-41a2-9443-c95151f05d02 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.232554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-92dec6c3-b546-41a2-9443-c95151f05d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.240824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 770/1563] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.242091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a949db-f236-48e9-a22e-7108361aa721 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.242389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a949db-f236-48e9-a22e-7108361aa721 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.242653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a949db-f236-48e9-a22e-7108361aa721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.251990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2821266e-0bb1-4eb1-a063-8e0c1628fb0b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.253208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2821266e-0bb1-4eb1-a063-8e0c1628fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.260320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d3a949db-f236-48e9-a22e-7108361aa721 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.261581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 794/1564] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.261702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d3a949db-f236-48e9-a22e-7108361aa721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.262112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821266e-0bb1-4eb1-a063-8e0c1628fb0b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.269633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 771/1565] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.270440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a949db-f236-48e9-a22e-7108361aa721 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.271529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821266e-0bb1-4eb1-a063-8e0c1628fb0b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.277610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8813ac-466d-4d2d-8b74-3a57235bff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.278564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8813ac-466d-4d2d-8b74-3a57235bff44 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.278870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8813ac-466d-4d2d-8b74-3a57235bff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.279110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8813ac-466d-4d2d-8b74-3a57235bff44 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.280262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8813ac-466d-4d2d-8b74-3a57235bff44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.280604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a949db-f236-48e9-a22e-7108361aa721 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.282258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8813ac-466d-4d2d-8b74-3a57235bff44 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.285756 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.286423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.286710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.286987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.287834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:56.288170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.289793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.313485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 772/1566] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:56.313485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.314308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 795/1567] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.314308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91c7f-1404-4f1a-b4be-c00de577547b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.314308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91c7f-1404-4f1a-b4be-c00de577547b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.314308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91c7f-1404-4f1a-b4be-c00de577547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.332001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-64b91c7f-1404-4f1a-b4be-c00de577547b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.333351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-64b91c7f-1404-4f1a-b4be-c00de577547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.341622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 796/1568] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.342275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91c7f-1404-4f1a-b4be-c00de577547b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.351928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91c7f-1404-4f1a-b4be-c00de577547b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.356473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd5ba8-3521-45f0-90c5-00f644bc649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.357164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5ba8-3521-45f0-90c5-00f644bc649a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.357444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5ba8-3521-45f0-90c5-00f644bc649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.357716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5ba8-3521-45f0-90c5-00f644bc649a admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.358444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd5ba8-3521-45f0-90c5-00f644bc649a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.360152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd5ba8-3521-45f0-90c5-00f644bc649a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.372385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 797/1569] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:56.373965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517cfbb-a8fc-480b-90ec-5b6e057c0324 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.374259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517cfbb-a8fc-480b-90ec-5b6e057c0324 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.374539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517cfbb-a8fc-480b-90ec-5b6e057c0324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.378167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f97795-c50f-469e-8312-9d7dc416c3ad admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.382380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.383042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.383324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.383598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.392802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b517cfbb-a8fc-480b-90ec-5b6e057c0324 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:56.393036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.394004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b517cfbb-a8fc-480b-90ec-5b6e057c0324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:56.394513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.402195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 798/1570] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:56.402860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517cfbb-a8fc-480b-90ec-5b6e057c0324 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.404379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 773/1571] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:53:56.405123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.413915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517cfbb-a8fc-480b-90ec-5b6e057c0324 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.414724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4691f6c-88a6-459d-acc4-1b2a1b3f9aa3 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.418729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.419398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.419664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.419808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.419998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.420786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.420786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.420987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:56.421095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.421193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.421597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:56.422261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.422745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.423892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.436671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 799/1572] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:56.444201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 774/1573] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:56.444201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.444417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.453394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477aa9-d99b-46cd-8beb-f94e0a5426ca admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.453818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61872de-50ca-4640-9c15-e85825e9381c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.458777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.459386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.459518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.459739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.460054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.460676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.460804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.461223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.461643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.461766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:53:56.461766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:53:56.461766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:53:56.462847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.463062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.465516 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.481476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 800/1574] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:56.482019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.494515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c594a-bc06-4978-8369-b2ea8137b9e5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.494724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 775/1575] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.495697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.566251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.567194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.567641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.568128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.569005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:56.569316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.570947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.577078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905ce59-aa1b-4790-bfe0-01fd2a8f6849 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.582935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.583623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.584026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 801/1576] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:56.584921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.587983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.588580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.589738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.592832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.595598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c42c-ac38-41f8-9400-4f12a69913fe admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.601755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.603013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.603013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.603266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.604054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:56.604375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.606200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.612446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 776/1577] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:56.613157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.629497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 802/1578] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:56.629497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.629815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4770f-b235-45af-a729-8a8a7ec86d7c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.633691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e3a7e-63c6-439c-8816-19fc71587d38 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.635199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.636333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.637186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.637433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.638096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.639423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.640054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.640251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.641040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.641576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.642275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.644185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.669591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 777/1579] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.674379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 803/1580] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.674576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.674688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.740762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938a5a-1844-443d-ab5c-2318e8dc3d91 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.742192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c104a70-09bd-4115-90f4-1ca5f16f0531 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.745698 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.746429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.746754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.747092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.747201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.747946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.748064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.748360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.748694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.749487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.750848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.751505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.766313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 778/1581] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:56.767551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.777252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ce91a-7a43-4cf0-841f-499a61338ec1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.778579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 804/1582] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.779624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.782763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.783554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.783930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.784278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.785058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.787224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.790505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ad4a9-894c-4876-abd2-00b8560dc97c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.795127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.796128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.796480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.796848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] PATH_INFO: `/v3/projects/8ff6bdb0a99948698dc413c12b120b61/users/1ded6e90b10949dcb921119073f2d26a/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.815061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff6bdb0a99948698dc413c12b120b61, user_id=1ded6e90b10949dcb921119073f2d26a, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.818017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.829217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 779/1583] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.829966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.845985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 805/1584] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:56 2022] PUT /identity/v3/projects/8ff6bdb0a99948698dc413c12b120b61/users/1ded6e90b10949dcb921119073f2d26a/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:56.849742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.921079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c598980-2f6b-455b-9e6e-408540861939 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.929182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.930006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.930519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.931903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.932255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc04e6-86b5-4e84-b623-f5eea500f6ee admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.932402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.933990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.938198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.938969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.939361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.939709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.940510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.942508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.964403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 806/1585] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.965145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.968552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 780/1586] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:56.968552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.977990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53870e-fa6f-42ea-a570-52122c8987df admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.039632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.040780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.040780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.040963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.041741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.043500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.045014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09c86-cc07-4670-9e8a-44aae1805a8f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.050711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.051655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.051969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.052341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] PATH_INFO: `/v3/projects/8159266bb76747dc8687d5884241dd29/users/461f929b4237427791b49ec3cb465091/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.071108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 807/1587] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:56 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:57.071108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.071402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8159266bb76747dc8687d5884241dd29, user_id=461f929b4237427791b49ec3cb465091, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.072289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.085026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b08f-9812-4e17-a22f-9503d885394c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.088112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 781/1588] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:56 2022] PUT /identity/v3/projects/8159266bb76747dc8687d5884241dd29/users/461f929b4237427791b49ec3cb465091/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:57.089027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.156075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa72de-caeb-4534-95a9-e960658845d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.156329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c706d04-ccab-4bb9-9eac-208eb46e37f1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.157471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa72de-caeb-4534-95a9-e960658845d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.157471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa72de-caeb-4534-95a9-e960658845d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.157471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa72de-caeb-4534-95a9-e960658845d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.158182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa72de-caeb-4534-95a9-e960658845d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.159948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa72de-caeb-4534-95a9-e960658845d1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.164928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.165719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.166026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.166292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.167125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.169244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.173695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 808/1589] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.173695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412cd73-326b-4a70-b3bb-c59f7733fb3f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.173695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412cd73-326b-4a70-b3bb-c59f7733fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.173695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412cd73-326b-4a70-b3bb-c59f7733fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.191725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e412cd73-326b-4a70-b3bb-c59f7733fb3f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:57.193276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e412cd73-326b-4a70-b3bb-c59f7733fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:57.197628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 782/1590] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:57 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:57.198635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.215493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 809/1591] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:57.215493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412cd73-326b-4a70-b3bb-c59f7733fb3f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.227609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b3f39-8982-4d33-a96a-468b026a9f0c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.229012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412cd73-326b-4a70-b3bb-c59f7733fb3f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.233345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.234028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.234340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.234620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8a81-f35c-475c-ae1f-208a99dff1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.234750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.235408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.235643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8a81-f35c-475c-ae1f-208a99dff1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.235777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8a81-f35c-475c-ae1f-208a99dff1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.236096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8a81-f35c-475c-ae1f-208a99dff1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.236935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8a81-f35c-475c-ae1f-208a99dff1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.237309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.238768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8a81-f35c-475c-ae1f-208a99dff1a4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.249896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 783/1592] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.251444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.264508 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe942e51-a5e9-4747-a593-b186042464ba admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.271624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.272417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.272788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.273050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.273932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.275675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.280818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 810/1593] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:57 2022] POST /identity/v3/users => generated 290 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:57.280818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1dcad-4e10-45e3-83ed-07bc476ed440 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.280818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1dcad-4e10-45e3-83ed-07bc476ed440 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.280818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1dcad-4e10-45e3-83ed-07bc476ed440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.288565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 784/1594] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.290915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.303731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c0e8a-0cd8-4a46-bf79-ef655301b30e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.307721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b0f1dcad-4e10-45e3-83ed-07bc476ed440 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:57.308834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.309560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.309840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.310117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.310889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b0f1dcad-4e10-45e3-83ed-07bc476ed440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:57.311015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.312961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.321293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 811/1595] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:57.325723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1dcad-4e10-45e3-83ed-07bc476ed440 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.328616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 785/1596] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.329599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.337206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1dcad-4e10-45e3-83ed-07bc476ed440 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.343348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.344184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.345010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.345636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.346542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.348207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.364108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 812/1597] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.364108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.378315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b738-ed46-4847-94e1-e4e95a2f14b6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.384803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.385970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.386598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.386882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.387807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.390107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.404816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 813/1598] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.405742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.407559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b38c0-9931-4a4a-b659-ca5adac94c29 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.411862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.412662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.413219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.413452 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.422372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322bf36-5781-4383-9174-87c8f07b8d59 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.425857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.427932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.429020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.429915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.430422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.430903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.431801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.435086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.440663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 786/1599] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:53:57.441713 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.449897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 814/1600] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.450901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.457195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862bb4d-f935-4bea-880c-c0638fe5b741 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.463135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9dee-e52c-4d17-a131-477bb7ba11ea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.463486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.464327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.465314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.465314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.465651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.467542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.471474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.472595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.472986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.473353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] PATH_INFO: `/v3/projects/1f1f4557b8bd4360ae6eb609fcd7f2ce/users/2578ccb10b284a49a5336f9eb57f3cc4/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.487976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 787/1601] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.489347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.498837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1f4557b8bd4360ae6eb609fcd7f2ce, user_id=2578ccb10b284a49a5336f9eb57f3cc4, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.503445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.505066 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9c60-b2ef-4262-9d1c-f4b66702dcca admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.513738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.514417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.514732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.515192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.527718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.529390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.531566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 815/1602] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:57 2022] PUT /identity/v3/projects/1f1f4557b8bd4360ae6eb609fcd7f2ce/users/2578ccb10b284a49a5336f9eb57f3cc4/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:57.532862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.564375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 788/1603] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:53:57.565672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.587805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58e3b-9cf1-496b-9519-9cf8fd6a4980 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.610993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45334-38e1-41fa-bb83-3d6a1a19e422 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.618868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.619969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.621373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.621766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.622787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.625278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.642613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 816/1604] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.642613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.656880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249d52-b99f-4a59-ae12-db00f872f8eb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.661896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.662695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.663346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.663724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.665439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.667183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.679860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 817/1605] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:57.680912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.692155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904f8ff-7fe1-408b-893f-23866ef26f3d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.697328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895729b-0819-4c53-bb06-fbd403529f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.698360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895729b-0819-4c53-bb06-fbd403529f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.698737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895729b-0819-4c53-bb06-fbd403529f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.699106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895729b-0819-4c53-bb06-fbd403529f40 admin admin] PATH_INFO: `/v3/projects/55a6554838094ba8a8b807bd90ec5bf4/users/18907451ac014573ba51f5f5f3939381/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.716227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.717151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.717433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.717707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] PATH_INFO: `/v3/projects/634e7491dc6e43f98fb82baba250b09b/users/fbe6cc242fbf40cf8250dabaa336f648/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.721397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895729b-0819-4c53-bb06-fbd403529f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a6554838094ba8a8b807bd90ec5bf4, user_id=18907451ac014573ba51f5f5f3939381, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.726824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895729b-0819-4c53-bb06-fbd403529f40 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.753573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] RBAC: Authorizing `identity:create_grant(project_id=634e7491dc6e43f98fb82baba250b09b, user_id=fbe6cc242fbf40cf8250dabaa336f648, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.755370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 818/1606] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:57 2022] PUT /identity/v3/projects/55a6554838094ba8a8b807bd90ec5bf4/users/18907451ac014573ba51f5f5f3939381/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:57.757010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.761644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcda6-1208-406a-9bc4-cff77be797c7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.761951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcda6-1208-406a-9bc4-cff77be797c7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.763307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcda6-1208-406a-9bc4-cff77be797c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.776280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 789/1607] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:57 2022] PUT /identity/v3/projects/634e7491dc6e43f98fb82baba250b09b/users/fbe6cc242fbf40cf8250dabaa336f648/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:57.777119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.813416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0a4fcda6-1208-406a-9bc4-cff77be797c7 None None] MFA Rules not processed for user `2578ccb10b284a49a5336f9eb57f3cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:57.816414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0a4fcda6-1208-406a-9bc4-cff77be797c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:57.924648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47a37-f5ed-473d-a79d-0b9086be878e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.939253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391371-221a-4dd9-a8f1-aa5b264fe41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.940216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391371-221a-4dd9-a8f1-aa5b264fe41d admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.940501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391371-221a-4dd9-a8f1-aa5b264fe41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.940824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391371-221a-4dd9-a8f1-aa5b264fe41d admin admin] PATH_INFO: `/v3/projects/d88cc8271f044d6ebd3709a053041ee8/users/4b8e783f0dda4b608f5e5e303393e250/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:57.947756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 819/1608] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:57.949006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fcda6-1208-406a-9bc4-cff77be797c7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:57.966536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fcda6-1208-406a-9bc4-cff77be797c7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:57.977356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391371-221a-4dd9-a8f1-aa5b264fe41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88cc8271f044d6ebd3709a053041ee8, user_id=4b8e783f0dda4b608f5e5e303393e250, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:57.981639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391371-221a-4dd9-a8f1-aa5b264fe41d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:57.986871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e49dcc-55fe-444e-b86f-03ad968f4cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:57.989258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49dcc-55fe-444e-b86f-03ad968f4cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:57.989650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49dcc-55fe-444e-b86f-03ad968f4cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:57.990064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49dcc-55fe-444e-b86f-03ad968f4cc5 admin admin] PATH_INFO: `/v3/projects/b18e153d167d499f9c09afe833fb86ad/users/ba46f93c5dc843e289122deb58d6e88c/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.010181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 790/1609] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:57 2022] PUT /identity/v3/projects/d88cc8271f044d6ebd3709a053041ee8/users/4b8e783f0dda4b608f5e5e303393e250/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:58.012096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585642b4-df7e-4dcb-80cc-a648c29cd0cf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.014745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585642b4-df7e-4dcb-80cc-a648c29cd0cf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.015226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585642b4-df7e-4dcb-80cc-a648c29cd0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.031580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e49dcc-55fe-444e-b86f-03ad968f4cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18e153d167d499f9c09afe833fb86ad, user_id=ba46f93c5dc843e289122deb58d6e88c, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:58.038170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e49dcc-55fe-444e-b86f-03ad968f4cc5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:58.067185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-585642b4-df7e-4dcb-80cc-a648c29cd0cf None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:58.068255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-585642b4-df7e-4dcb-80cc-a648c29cd0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:58.099322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 820/1610] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:57 2022] PUT /identity/v3/projects/b18e153d167d499f9c09afe833fb86ad/users/ba46f93c5dc843e289122deb58d6e88c/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:58.101443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cc60c-2e4e-4ba4-895d-ea06df805c86 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.101875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cc60c-2e4e-4ba4-895d-ea06df805c86 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.102249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cc60c-2e4e-4ba4-895d-ea06df805c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.147249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b42cc60c-2e4e-4ba4-895d-ea06df805c86 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:58.150523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b42cc60c-2e4e-4ba4-895d-ea06df805c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:58.170227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 791/1611] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:58.173955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde1e8-ff96-4f80-9d6f-548feed4a7e7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.174562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde1e8-ff96-4f80-9d6f-548feed4a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.175126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde1e8-ff96-4f80-9d6f-548feed4a7e7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.177275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 792/1612] 10.222.0.99 () {54 vars in 961 bytes} [Fri May 13 14:53:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:53:58.178731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd7dc-e18b-44b1-ac57-8b2b3e3bc554 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.179175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd7dc-e18b-44b1-ac57-8b2b3e3bc554 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.179631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd7dc-e18b-44b1-ac57-8b2b3e3bc554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.211794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fbdbd7dc-e18b-44b1-ac57-8b2b3e3bc554 None None] MFA Rules not processed for user `4b8e783f0dda4b608f5e5e303393e250`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:58.213076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fbdbd7dc-e18b-44b1-ac57-8b2b3e3bc554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:58.270078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 821/1613] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:58.271720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9064-0e42-4bcf-8600-a8d0692f6937 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.272354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9064-0e42-4bcf-8600-a8d0692f6937 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.272740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc9064-0e42-4bcf-8600-a8d0692f6937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.309762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1ddc9064-0e42-4bcf-8600-a8d0692f6937 None None] MFA Rules not processed for user `ba46f93c5dc843e289122deb58d6e88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:58.311474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1ddc9064-0e42-4bcf-8600-a8d0692f6937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:58.365930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 793/1614] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:58.365930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2611af-a8a3-4dd4-a4ce-564d3278c633 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.366304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2611af-a8a3-4dd4-a4ce-564d3278c633 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.366601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2611af-a8a3-4dd4-a4ce-564d3278c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.403714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-af2611af-a8a3-4dd4-a4ce-564d3278c633 None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:58.405020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af2611af-a8a3-4dd4-a4ce-564d3278c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:58.407050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 822/1615] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:58.407961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc9064-0e42-4bcf-8600-a8d0692f6937 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:58.496046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 794/1616] 10.222.0.99 () {58 vars in 1058 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:58.497461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2611af-a8a3-4dd4-a4ce-564d3278c633 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:58.511712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2611af-a8a3-4dd4-a4ce-564d3278c633 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:58.515912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:58.516839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.517324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.517787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.518740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:58.521957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:58.543010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc9064-0e42-4bcf-8600-a8d0692f6937 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:58.552725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:58.553850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.556621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.557875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.572299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 795/1617] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:58.574865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:58.587591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:58.591995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:58.621201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 823/1618] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:53:58.622218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:58.638754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2071b09-4a45-4b18-bb2f-6bf00f1dc416 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:58.683139 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea539e75-99ce-4f10-88dc-2e6eedec88d8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:58.690783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:58.700975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.701211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.701503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.702224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:58.704494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:58.747571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:58.749833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.750735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.751718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.756578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 796/1619] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:58.757544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:58.773928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:58.776595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:58.791594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 824/1620] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:53:58.796451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:58.823585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d307ac-387d-461c-936b-4dcca2a30df5 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:58.899008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f8cfa-b739-49a4-9d90-281315894cf2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:58.911182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:58.911891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.912170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.912449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.946566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:58.947880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:58.948376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:58.948860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:58.949778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:58.954320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.027793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 825/1621] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:58 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:59.028803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.050008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.052847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11dfe-614b-481e-baef-35ae7ba05d9c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.057288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.064234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d122c-ba97-4b06-90d0-25b1e042de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.066487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d122c-ba97-4b06-90d0-25b1e042de18 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.067961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d122c-ba97-4b06-90d0-25b1e042de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.068430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d122c-ba97-4b06-90d0-25b1e042de18 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.070670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d122c-ba97-4b06-90d0-25b1e042de18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.075750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d122c-ba97-4b06-90d0-25b1e042de18 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.100580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 797/1622] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:53:59.106593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.145787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31cae-430d-4131-82f4-b30a0028b86c service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.154009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 826/1623] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:53:59 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:59.156040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b55e2-9ee4-441e-89e1-a2e7d8fa56a7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.157111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b55e2-9ee4-441e-89e1-a2e7d8fa56a7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.157933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b55e2-9ee4-441e-89e1-a2e7d8fa56a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.163261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.164650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.165350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.166076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.168025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.172246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.208179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 798/1624] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:59.209949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.211754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c68b55e2-9ee4-441e-89e1-a2e7d8fa56a7 None None] MFA Rules not processed for user `461f929b4237427791b49ec3cb465091`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:59.213688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c68b55e2-9ee4-441e-89e1-a2e7d8fa56a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:59.241277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cac47-51d8-40bb-ab04-7216eabb3cc3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.260835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.266393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.271676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.274802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.280152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.282937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.314739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 827/1625] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:59.315701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b55e2-9ee4-441e-89e1-a2e7d8fa56a7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.318627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 799/1626] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:59.325263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.333360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b55e2-9ee4-441e-89e1-a2e7d8fa56a7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.344083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec11a34-d4d4-44a6-b238-f160c73cb1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.346657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec11a34-d4d4-44a6-b238-f160c73cb1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.346657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec11a34-d4d4-44a6-b238-f160c73cb1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.347695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec11a34-d4d4-44a6-b238-f160c73cb1f1 admin admin] PATH_INFO: `/v3/projects/fe975977e02b48f9869b5ba4bfb19297/users/1e99758d7e724dbd93a74b31540f188b/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.375400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bfc4d-18af-467f-9e11-99e5fc278f6a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.395334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.396285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.396573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.396855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] PATH_INFO: `/v3/projects/e0965b1521c648daae7118d73325b410/users/f8725f8097e844c8b549390f597004cc/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.406765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec11a34-d4d4-44a6-b238-f160c73cb1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe975977e02b48f9869b5ba4bfb19297, user_id=1e99758d7e724dbd93a74b31540f188b, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.410258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec11a34-d4d4-44a6-b238-f160c73cb1f1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.437504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 828/1627] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:59 2022] PUT /identity/v3/projects/fe975977e02b48f9869b5ba4bfb19297/users/1e99758d7e724dbd93a74b31540f188b/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:59.439192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f31ef-fbbf-42a5-ba87-d1eeee5af071 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.439549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f31ef-fbbf-42a5-ba87-d1eeee5af071 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.439952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f31ef-fbbf-42a5-ba87-d1eeee5af071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.456521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0965b1521c648daae7118d73325b410, user_id=f8725f8097e844c8b549390f597004cc, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.459284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.474083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-675f31ef-fbbf-42a5-ba87-d1eeee5af071 None None] MFA Rules not processed for user `461f929b4237427791b49ec3cb465091`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:59.476755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-675f31ef-fbbf-42a5-ba87-d1eeee5af071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:59.494919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 800/1628] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:59 2022] PUT /identity/v3/projects/e0965b1521c648daae7118d73325b410/users/f8725f8097e844c8b549390f597004cc/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:53:59.494919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.616328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d37f-79e2-4591-a07e-61b19b445a33 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.621886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50ca04-ffec-4f2c-950c-79412264b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.622780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50ca04-ffec-4f2c-950c-79412264b701 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.623530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50ca04-ffec-4f2c-950c-79412264b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.624089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50ca04-ffec-4f2c-950c-79412264b701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.625059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50ca04-ffec-4f2c-950c-79412264b701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.627377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50ca04-ffec-4f2c-950c-79412264b701 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.639667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 829/1629] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:59.645748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 801/1630] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:59.647502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8037c-c639-4b28-93e1-1d5037dfc228 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.648005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8037c-c639-4b28-93e1-1d5037dfc228 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.648495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8037c-c639-4b28-93e1-1d5037dfc228 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.648801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f31ef-fbbf-42a5-ba87-d1eeee5af071 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.654830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 802/1631] 10.222.0.99 () {54 vars in 912 bytes} [Fri May 13 14:53:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:53:59.656116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8037c-c639-4b28-93e1-1d5037dfc228 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.670466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8037c-c639-4b28-93e1-1d5037dfc228 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.678631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f31ef-fbbf-42a5-ba87-d1eeee5af071 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.681364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd11d71-0fef-4be3-bddf-5395052259d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.682284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11d71-0fef-4be3-bddf-5395052259d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.682571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11d71-0fef-4be3-bddf-5395052259d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.682851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11d71-0fef-4be3-bddf-5395052259d3 admin admin] PATH_INFO: `/v3/projects/fe975977e02b48f9869b5ba4bfb19297/users/1e99758d7e724dbd93a74b31540f188b/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.685571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd11d71-0fef-4be3-bddf-5395052259d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe975977e02b48f9869b5ba4bfb19297, user_id=1e99758d7e724dbd93a74b31540f188b, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.692527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83904b-9db4-4977-ad95-ad44ab6588f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.693235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83904b-9db4-4977-ad95-ad44ab6588f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.693733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83904b-9db4-4977-ad95-ad44ab6588f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.693854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd11d71-0fef-4be3-bddf-5395052259d3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.694020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83904b-9db4-4977-ad95-ad44ab6588f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.694821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83904b-9db4-4977-ad95-ad44ab6588f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:59.702909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83904b-9db4-4977-ad95-ad44ab6588f5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:59.715484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 803/1632] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:59 2022] PUT /identity/v3/projects/fe975977e02b48f9869b5ba4bfb19297/users/1e99758d7e724dbd93a74b31540f188b/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:53:59.717352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab773a4-ecf1-4b28-83e1-674bc3f5f45b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.717870 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab773a4-ecf1-4b28-83e1-674bc3f5f45b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.718354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab773a4-ecf1-4b28-83e1-674bc3f5f45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.734629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 830/1633] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:53:59.734629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3a7d-640c-4799-9caa-1958d28488f2 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.734629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3a7d-640c-4799-9caa-1958d28488f2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.734629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3a7d-640c-4799-9caa-1958d28488f2 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.735542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 831/1634] 10.222.0.99 () {54 vars in 961 bytes} [Fri May 13 14:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:53:59.750109 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1ab773a4-ecf1-4b28-83e1-674bc3f5f45b None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:59.751749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1ab773a4-ecf1-4b28-83e1-674bc3f5f45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:59.752911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd09b7a-cc25-4847-b552-487f7b3bd4d0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.753215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd09b7a-cc25-4847-b552-487f7b3bd4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.753505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd09b7a-cc25-4847-b552-487f7b3bd4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.814329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9fd09b7a-cc25-4847-b552-487f7b3bd4d0 None None] MFA Rules not processed for user `1e99758d7e724dbd93a74b31540f188b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:59.816281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9fd09b7a-cc25-4847-b552-487f7b3bd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:59.870977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 804/1635] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:59.872166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab773a4-ecf1-4b28-83e1-674bc3f5f45b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.970271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 832/1636] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:53:59.984250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1870f3-2ed4-4804-988b-c3c82d255402 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.984658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1870f3-2ed4-4804-988b-c3c82d255402 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.985165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1870f3-2ed4-4804-988b-c3c82d255402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.015268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-db1870f3-2ed4-4804-988b-c3c82d255402 None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:00.019068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-db1870f3-2ed4-4804-988b-c3c82d255402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:00.025110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab773a4-ecf1-4b28-83e1-674bc3f5f45b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.035907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.038860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.039150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.040177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 833/1637] 10.222.0.99 () {58 vars in 1058 bytes} [Fri May 13 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:00.040311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] PATH_INFO: `/v3/projects/e0965b1521c648daae7118d73325b410/users/f8725f8097e844c8b549390f597004cc/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.041963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1870f3-2ed4-4804-988b-c3c82d255402 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.044810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0965b1521c648daae7118d73325b410, user_id=f8725f8097e844c8b549390f597004cc, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.050033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.086151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 805/1638] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:53:59 2022] PUT /identity/v3/projects/e0965b1521c648daae7118d73325b410/users/f8725f8097e844c8b549390f597004cc/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:00.087791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.176497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1870f3-2ed4-4804-988b-c3c82d255402 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.219673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbd3fb-68e8-44a5-b4e6-7886cd8a87dc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.230654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.235487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.236291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.236587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.301496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6105a36-daf2-45b9-acdf-c502d73c4a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.302178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6105a36-daf2-45b9-acdf-c502d73c4a71 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.302461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6105a36-daf2-45b9-acdf-c502d73c4a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.302739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6105a36-daf2-45b9-acdf-c502d73c4a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.387943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.389336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.426164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 806/1639] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:00.428825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.485127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6105a36-daf2-45b9-acdf-c502d73c4a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.486797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6105a36-daf2-45b9-acdf-c502d73c4a71 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.514285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 834/1640] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:00.518545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9235c2-e0c3-44ba-94f6-568d6297d655 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.519062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9235c2-e0c3-44ba-94f6-568d6297d655 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.519357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9235c2-e0c3-44ba-94f6-568d6297d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.601733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ea9235c2-e0c3-44ba-94f6-568d6297d655 None None] MFA Rules not processed for user `f8725f8097e844c8b549390f597004cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:00.608847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ea9235c2-e0c3-44ba-94f6-568d6297d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:00.644603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b9d73-da3a-48e3-80ed-913d5d80a7d1 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.671058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.673114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.673603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.675169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.802194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 835/1641] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:00.860032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.867189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.892862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9235c2-e0c3-44ba-94f6-568d6297d655 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.896149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 807/1642] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:00.905127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9235c2-e0c3-44ba-94f6-568d6297d655 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.918717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ee6a2-ae33-489b-8a73-52209d063011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.919820 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee6a2-ae33-489b-8a73-52209d063011 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.920354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee6a2-ae33-489b-8a73-52209d063011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.920860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ee6a2-ae33-489b-8a73-52209d063011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.944114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ee6a2-ae33-489b-8a73-52209d063011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.945960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ee6a2-ae33-489b-8a73-52209d063011 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.988793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 836/1643] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:01.506722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:01.518777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9035a2-dcfa-4ee3-85a5-48e70a7b4e00 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:01.521457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63a2ab-a7ae-471b-b8a7-58da9c009a29 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:01.521946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63a2ab-a7ae-471b-b8a7-58da9c009a29 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:01.522061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63a2ab-a7ae-471b-b8a7-58da9c009a29 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:01.523721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 837/1644] 10.222.0.99 () {54 vars in 912 bytes} [Fri May 13 14:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:54:01.530506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:01.532965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:01.533264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:01.533555 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:01.536376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:01.536666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:01.536942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:01.567921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:01.572058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:01.598046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 838/1645] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:01.615082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:01.616683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:01.705192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:01.708230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:01.733020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44517bc9-d644-4614-8f46-d38b0ab41c1e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:01.736500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 808/1646] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:01.743789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518ac7-7d84-4236-ab54-83e6610c83fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:01.744759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518ac7-7d84-4236-ab54-83e6610c83fe service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:01.745499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518ac7-7d84-4236-ab54-83e6610c83fe service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:01.745941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518ac7-7d84-4236-ab54-83e6610c83fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:01.769489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79518ac7-7d84-4236-ab54-83e6610c83fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:01.771564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79518ac7-7d84-4236-ab54-83e6610c83fe service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:01.824215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 839/1647] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:02.478527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:02.688262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397590-820a-4791-86dc-783b9faa7373 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:02.696973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:02.699657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:02.700384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:02.700842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] PATH_INFO: `/v3/users/4b8e783f0dda4b608f5e5e303393e250` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:02.702405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8e783f0dda4b608f5e5e303393e250)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:02.703706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:54:02.703706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 13 14:54:02.703706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: May 13 14:54:02.705481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:02.820447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8e783f0dda4b608f5e5e303393e250'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:02.850806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8e783f0dda4b608f5e5e303393e250'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:02.852326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8e783f0dda4b608f5e5e303393e250'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:02.889520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8e783f0dda4b608f5e5e303393e250'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:02.890954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8e783f0dda4b608f5e5e303393e250'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:02.922063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 809/1648] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:02 2022] DELETE /identity/v3/users/4b8e783f0dda4b608f5e5e303393e250 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:02.927451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce146-0218-4f39-88e9-afc4c7c74b30 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:02.928509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce146-0218-4f39-88e9-afc4c7c74b30 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:02.929017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce146-0218-4f39-88e9-afc4c7c74b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:02.962758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-68fce146-0218-4f39-88e9-afc4c7c74b30 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:02.965213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-68fce146-0218-4f39-88e9-afc4c7c74b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:03.084643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 840/1649] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:03.104968 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:03.106614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:03.244881 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f889d5-520f-463d-adcc-a648138aafc9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:03.249240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85aaaf-22af-442c-b417-ca7bd6ad1075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:03.249993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85aaaf-22af-442c-b417-ca7bd6ad1075 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:03.250313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85aaaf-22af-442c-b417-ca7bd6ad1075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:03.250683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85aaaf-22af-442c-b417-ca7bd6ad1075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:03.263616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85aaaf-22af-442c-b417-ca7bd6ad1075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:03.266486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85aaaf-22af-442c-b417-ca7bd6ad1075 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:03.288581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 810/1650] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:03.986762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4310-6b80-4505-b066-5d6fa2e94786 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:03.987625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4310-6b80-4505-b066-5d6fa2e94786 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:03.988132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4310-6b80-4505-b066-5d6fa2e94786 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:03.990303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 841/1651] 10.222.0.99 () {54 vars in 912 bytes} [Fri May 13 14:54:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:04.000601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:04.001113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:04.001113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:04.154389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] MFA Rules not processed for user `81e8247739e24fcd9b067f1aa1cb9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:04.156022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:04.182313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 811/1652] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:04.289782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde4310-6b80-4505-b066-5d6fa2e94786 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:04.292547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9fde4310-6b80-4505-b066-5d6fa2e94786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:04.358533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde4310-6b80-4505-b066-5d6fa2e94786 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:04.373440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:04.373995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:04.376262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:04.376737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:04.415236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:04.416931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:04.436787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 842/1653] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:04.835515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:04.837137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:04.863432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b304c-9dca-4392-ba20-e7bd5405f11b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:04.880045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:04.881441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:04.881731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:04.882013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] PATH_INFO: `/v3/projects/d88cc8271f044d6ebd3709a053041ee8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:04.887986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88cc8271f044d6ebd3709a053041ee8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:04.890221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:04.976284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88cc8271f044d6ebd3709a053041ee8', 'request_id': 'req-96c6218d-a39c-4e1e-8c08-60501e865f21'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:04.984797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88cc8271f044d6ebd3709a053041ee8', 'request_id': 'req-96c6218d-a39c-4e1e-8c08-60501e865f21'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.002226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88cc8271f044d6ebd3709a053041ee8', 'request_id': 'req-96c6218d-a39c-4e1e-8c08-60501e865f21'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.018721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] The token cache is being invalidate because project d88cc8271f044d6ebd3709a053041ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:05.019463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.020476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c6218d-a39c-4e1e-8c08-60501e865f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.024440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 812/1654] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:04 2022] DELETE /identity/v3/projects/d88cc8271f044d6ebd3709a053041ee8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:05.028543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:05.044689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9806a4-a4cb-4547-b97b-9cc9e26a4e8e service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:05.179033 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:05.180656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:05.181105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:05.181690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] PATH_INFO: `/v3/users/1e99758d7e724dbd93a74b31540f188b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:05.183285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e99758d7e724dbd93a74b31540f188b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:05.185486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:05.325111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e99758d7e724dbd93a74b31540f188b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.346334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e99758d7e724dbd93a74b31540f188b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.366972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e99758d7e724dbd93a74b31540f188b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.380349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e99758d7e724dbd93a74b31540f188b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.381351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b6a4fd51-fc1e-40b1-8034-484ed55b0885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e99758d7e724dbd93a74b31540f188b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:05.392116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 843/1655] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:05 2022] DELETE /identity/v3/users/1e99758d7e724dbd93a74b31540f188b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:06.309828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290f04-610b-4ab8-b222-25c4b6a36c4d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:06.310280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290f04-610b-4ab8-b222-25c4b6a36c4d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:06.310378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290f04-610b-4ab8-b222-25c4b6a36c4d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:06.312508 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 813/1656] 10.222.0.99 () {54 vars in 960 bytes} [Fri May 13 14:54:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:06.320687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:06.321209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:06.321308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:06.365352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] MFA Rules not processed for user `f3b12b26b87d438c8f4eb61c8a93b31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:06.366761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:06.477782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290f04-610b-4ab8-b222-25c4b6a36c4d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:06.491554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 844/1657] 10.222.0.99 () {58 vars in 1057 bytes} [Fri May 13 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:06.499617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290f04-610b-4ab8-b222-25c4b6a36c4d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:06.510894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0e7f6-cbca-469c-86d8-715c9b88d6f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:06.513064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0e7f6-cbca-469c-86d8-715c9b88d6f2 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:06.513706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0e7f6-cbca-469c-86d8-715c9b88d6f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:06.514712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0e7f6-cbca-469c-86d8-715c9b88d6f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:06.519749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-47a0e7f6-cbca-469c-86d8-715c9b88d6f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:06.536600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0e7f6-cbca-469c-86d8-715c9b88d6f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:06.538169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0e7f6-cbca-469c-86d8-715c9b88d6f2 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:06.565396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 814/1658] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:07.079718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:07.081790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:07.246995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472db2e-f827-427b-8927-c9ba057eb2c9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:07.254482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:07.255990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.256331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.256615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] PATH_INFO: `/v3/projects/fe975977e02b48f9869b5ba4bfb19297` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.258670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe975977e02b48f9869b5ba4bfb19297)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:07.259945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:54:07.259945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 13 14:54:07.259945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: May 13 14:54:07.261188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:07.378103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe975977e02b48f9869b5ba4bfb19297', 'request_id': 'req-8f21da08-cf7a-489a-a3b4-56e0aac447c8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:07.414261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe975977e02b48f9869b5ba4bfb19297', 'request_id': 'req-8f21da08-cf7a-489a-a3b4-56e0aac447c8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:07.431861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe975977e02b48f9869b5ba4bfb19297', 'request_id': 'req-8f21da08-cf7a-489a-a3b4-56e0aac447c8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:07.475618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] The token cache is being invalidate because project fe975977e02b48f9869b5ba4bfb19297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:07.476503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:07.477384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8f21da08-cf7a-489a-a3b4-56e0aac447c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:07.480726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 845/1659] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:07 2022] DELETE /identity/v3/projects/fe975977e02b48f9869b5ba4bfb19297 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:07.485703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f490-f007-46a8-aee6-b2f740da7314 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.486913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f490-f007-46a8-aee6-b2f740da7314 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.487365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f490-f007-46a8-aee6-b2f740da7314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.531952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1db3f490-f007-46a8-aee6-b2f740da7314 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:07.534747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1db3f490-f007-46a8-aee6-b2f740da7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:07.718076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 815/1660] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:07.726497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a78e5-e84c-44a4-9cef-214de4ee85ed None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.730169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a78e5-e84c-44a4-9cef-214de4ee85ed None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.731152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a78e5-e84c-44a4-9cef-214de4ee85ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.772909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-893a78e5-e84c-44a4-9cef-214de4ee85ed None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:07.795496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-893a78e5-e84c-44a4-9cef-214de4ee85ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:07.833864 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 846/1661] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:07.838550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3f490-f007-46a8-aee6-b2f740da7314 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:07.853738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3f490-f007-46a8-aee6-b2f740da7314 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:07.867618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269d3e3-e7c3-4145-9490-f488d27b8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:07.868773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d3e3-e7c3-4145-9490-f488d27b8ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.869318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d3e3-e7c3-4145-9490-f488d27b8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.869655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d3e3-e7c3-4145-9490-f488d27b8ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.871151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d3e3-e7c3-4145-9490-f488d27b8ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:07.872865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d3e3-e7c3-4145-9490-f488d27b8ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:07.878498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d3e3-e7c3-4145-9490-f488d27b8ef2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:07.912462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a78e5-e84c-44a4-9cef-214de4ee85ed None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:07.919339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 816/1662] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:07.928850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a78e5-e84c-44a4-9cef-214de4ee85ed None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:07.946321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:07.947028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.947318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.947638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.948448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:07.952715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.029740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.030260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.032602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.063398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 847/1663] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:07 2022] POST /identity/v3/projects => generated 355 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:08.068000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.114086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] MFA Rules not processed for user `ac89928ac188406d910838be33a61c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:08.115759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:08.269342 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7234d68-e9ff-445f-ba07-34f6dc5ff132 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.283451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.284372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.284654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.284929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.289977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.292063 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.318671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 817/1664] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:08.335393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.337252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:08.340339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 848/1665] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:08 2022] POST /identity/v3/users => generated 278 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:08.344756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.370570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f667784-7cb4-4878-b0c9-8712e4843458 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.379412 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.380353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.382471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.382471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.383022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.385268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.404255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 849/1666] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:08.408308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.427112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3457d3-0690-4ac2-9253-4abeabffa379 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.438611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.440779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.441113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.441608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.446331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.449047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.469517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 850/1667] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:08.481354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.493521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f16b46-2734-4885-a3d7-790df6af369c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.493978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dd607-0ad4-42c2-886f-55cd800ca977 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.500236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc67ad-4ec0-46cf-80b5-816bc5253ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.501425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc67ad-4ec0-46cf-80b5-816bc5253ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.501708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc67ad-4ec0-46cf-80b5-816bc5253ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.501988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc67ad-4ec0-46cf-80b5-816bc5253ae3 admin admin] PATH_INFO: `/v3/projects/a849983cefb9409db7c0af498a43f300/users/32f28389142942b9b3721f7ebe1e8889/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.531560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc67ad-4ec0-46cf-80b5-816bc5253ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a849983cefb9409db7c0af498a43f300, user_id=32f28389142942b9b3721f7ebe1e8889, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.536618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc67ad-4ec0-46cf-80b5-816bc5253ae3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.542813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.543855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.544401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.545191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.562068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.564719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.568901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 851/1668] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:08 2022] PUT /identity/v3/projects/a849983cefb9409db7c0af498a43f300/users/32f28389142942b9b3721f7ebe1e8889/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:08.583776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 818/1669] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:08.587587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f064-1175-4996-aef2-dccc6a367e0e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.587988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f064-1175-4996-aef2-dccc6a367e0e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.588209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f064-1175-4996-aef2-dccc6a367e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.624934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-fe22f064-1175-4996-aef2-dccc6a367e0e None None] MFA Rules not processed for user `32f28389142942b9b3721f7ebe1e8889`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:08.627238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fe22f064-1175-4996-aef2-dccc6a367e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:08.753975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 852/1670] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:08.755560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.781287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32615-ec6a-4c46-b783-8cc187755cd9 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.903578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.904985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.905585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.906088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.906976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.918130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:09.004859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f064-1175-4996-aef2-dccc6a367e0e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:09.015655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 819/1671] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:08 2022] POST /identity/v3/projects => generated 355 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:09.032967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f064-1175-4996-aef2-dccc6a367e0e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:09.185685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:09.186553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:09.186891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:09.188500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:09.189317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:09.201031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:09.249625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 853/1672] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:09 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:09.252086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:09.268231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823b58b-bcd8-43e0-98e3-b9058a47aa08 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:09.282069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:09.282837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:09.283113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:09.283491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:09.285894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:09.288828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:09.319669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 820/1673] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:09.324463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:09.343523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cfd83-59a3-4487-b369-ac5d89a2291f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:09.357402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:09.360299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:09.360818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:09.361534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] PATH_INFO: `/v3/projects/07d0b0d0bdab42fdb9c2b68b46454926/users/504b97856c9a4e0ba1aeb02eb64d9aad/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:09.409936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d0b0d0bdab42fdb9c2b68b46454926, user_id=504b97856c9a4e0ba1aeb02eb64d9aad, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:09.419640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:09.454140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 854/1674] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:09 2022] PUT /identity/v3/projects/07d0b0d0bdab42fdb9c2b68b46454926/users/504b97856c9a4e0ba1aeb02eb64d9aad/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:09.458745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:09.477571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abfd27-3775-4927-bee0-97a25d841220 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:09.644010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eead7a-c3c3-4754-b570-b038aef8e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:09.645505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eead7a-c3c3-4754-b570-b038aef8e843 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:09.645859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eead7a-c3c3-4754-b570-b038aef8e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:09.649941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eead7a-c3c3-4754-b570-b038aef8e843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:09.650893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eead7a-c3c3-4754-b570-b038aef8e843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:09.652732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eead7a-c3c3-4754-b570-b038aef8e843 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:09.681346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 821/1675] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:09.682237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:09.702891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447b6-a7e2-46cc-97b9-aa0fc71f8aff admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:09.718160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:09.719810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:09.720121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:09.720402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] PATH_INFO: `/v3/projects/07d0b0d0bdab42fdb9c2b68b46454926/users/504b97856c9a4e0ba1aeb02eb64d9aad/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:09.725161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d0b0d0bdab42fdb9c2b68b46454926, user_id=504b97856c9a4e0ba1aeb02eb64d9aad, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:09.732234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:09.763505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 855/1676] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:09 2022] PUT /identity/v3/projects/07d0b0d0bdab42fdb9c2b68b46454926/users/504b97856c9a4e0ba1aeb02eb64d9aad/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:09.775821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ee9f2-10ba-4fbb-94d5-3b5e96b9ccd4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:09.776218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ee9f2-10ba-4fbb-94d5-3b5e96b9ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:09.776564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ee9f2-10ba-4fbb-94d5-3b5e96b9ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:09.832662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7d6ee9f2-10ba-4fbb-94d5-3b5e96b9ccd4 None None] MFA Rules not processed for user `504b97856c9a4e0ba1aeb02eb64d9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:09.834090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7d6ee9f2-10ba-4fbb-94d5-3b5e96b9ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:09.998169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 822/1677] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:10.010714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:10.013418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:10.132620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e462-ef2d-4349-bb71-10621d5d6cd6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:10.137676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce53ba9-e0d2-4cfc-8482-3caffc347fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:10.138518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce53ba9-e0d2-4cfc-8482-3caffc347fbc service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:10.138983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce53ba9-e0d2-4cfc-8482-3caffc347fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:10.139315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce53ba9-e0d2-4cfc-8482-3caffc347fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:10.164875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce53ba9-e0d2-4cfc-8482-3caffc347fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:10.169152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce53ba9-e0d2-4cfc-8482-3caffc347fbc service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:10.184550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 856/1678] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:10 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:10.299604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ee9f2-10ba-4fbb-94d5-3b5e96b9ccd4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:10.312879 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ee9f2-10ba-4fbb-94d5-3b5e96b9ccd4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:10.323698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:10.325102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:10.325562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:10.326010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:10.498127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:10.503190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:10.530611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 823/1679] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:10 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:11.129816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03214c9-ab42-4409-bf1f-64a419d8e314 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:11.130916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03214c9-ab42-4409-bf1f-64a419d8e314 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:11.132132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03214c9-ab42-4409-bf1f-64a419d8e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:11.223567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b03214c9-ab42-4409-bf1f-64a419d8e314 None None] MFA Rules not processed for user `1ded6e90b10949dcb921119073f2d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:11.224924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b03214c9-ab42-4409-bf1f-64a419d8e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:11.400529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 857/1680] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:11.423096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:11.425466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:11.633148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dcc02-fafc-485c-a1ea-f229958141a0 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:11.649560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:11.650299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:11.650585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:11.650862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:11.675961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:11.679596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:11.712265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 824/1681] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:12.363170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d388d1e-6691-4862-804c-20a8af54ddf0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:12.363759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d388d1e-6691-4862-804c-20a8af54ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:12.363759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d388d1e-6691-4862-804c-20a8af54ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:12.445861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7d388d1e-6691-4862-804c-20a8af54ddf0 None None] MFA Rules not processed for user `fbe6cc242fbf40cf8250dabaa336f648`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:12.448068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7d388d1e-6691-4862-804c-20a8af54ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:12.567438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 858/1682] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:12.581841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:12.595838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7cbc7-b094-4861-a53c-1c934b723c7c service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:12.616251 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062cf8b-8fad-4cb3-ab64-f1f1881d1675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:12.617309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cf8b-8fad-4cb3-ab64-f1f1881d1675 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:12.617787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cf8b-8fad-4cb3-ab64-f1f1881d1675 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:12.618259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cf8b-8fad-4cb3-ab64-f1f1881d1675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:12.629234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062cf8b-8fad-4cb3-ab64-f1f1881d1675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:12.634843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062cf8b-8fad-4cb3-ab64-f1f1881d1675 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:12.650148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 825/1683] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:14.929916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75be63-afcb-4282-9476-5a11fa986f58 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:14.930554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75be63-afcb-4282-9476-5a11fa986f58 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:14.930554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75be63-afcb-4282-9476-5a11fa986f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:14.962934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-de75be63-afcb-4282-9476-5a11fa986f58 None None] MFA Rules not processed for user `ac89928ac188406d910838be33a61c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:14.965773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-de75be63-afcb-4282-9476-5a11fa986f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:15.023048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 859/1684] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:15.068671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba026c-ac37-47ee-bffe-08ccc98ac982 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:15.069276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba026c-ac37-47ee-bffe-08ccc98ac982 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:15.069529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba026c-ac37-47ee-bffe-08ccc98ac982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:15.098813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7eba026c-ac37-47ee-bffe-08ccc98ac982 None None] MFA Rules not processed for user `18907451ac014573ba51f5f5f3939381`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:15.100552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7eba026c-ac37-47ee-bffe-08ccc98ac982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:15.180983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 826/1685] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:15.193454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6d29-d916-4319-b399-23339c251252 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:15.193840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6d29-d916-4319-b399-23339c251252 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:15.194103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6d29-d916-4319-b399-23339c251252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:15.256033 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e68f6d29-d916-4319-b399-23339c251252 None None] MFA Rules not processed for user `18907451ac014573ba51f5f5f3939381`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:15.259565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e68f6d29-d916-4319-b399-23339c251252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:15.274293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 860/1686] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:15.299724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba026c-ac37-47ee-bffe-08ccc98ac982 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:15.313423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba026c-ac37-47ee-bffe-08ccc98ac982 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:15.319313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317a3b0-3350-43ba-83ef-e6f87db8b76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:15.320231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317a3b0-3350-43ba-83ef-e6f87db8b76d service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:15.320670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317a3b0-3350-43ba-83ef-e6f87db8b76d service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:15.321075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317a3b0-3350-43ba-83ef-e6f87db8b76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:15.331081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317a3b0-3350-43ba-83ef-e6f87db8b76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:15.333278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317a3b0-3350-43ba-83ef-e6f87db8b76d service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:15.352118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 827/1687] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:16.110737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bf46b-e3d5-4350-bfb6-824f6af51e50 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:16.111331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bf46b-e3d5-4350-bfb6-824f6af51e50 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:16.111331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bf46b-e3d5-4350-bfb6-824f6af51e50 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:16.112994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 861/1688] 10.222.0.99 () {54 vars in 912 bytes} [Fri May 13 14:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:16.120871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29440d15-6019-47eb-97b3-1b0d6155b47a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:16.121364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29440d15-6019-47eb-97b3-1b0d6155b47a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:16.121444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29440d15-6019-47eb-97b3-1b0d6155b47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:16.168277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-29440d15-6019-47eb-97b3-1b0d6155b47a None None] MFA Rules not processed for user `81e8247739e24fcd9b067f1aa1cb9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:16.169816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-29440d15-6019-47eb-97b3-1b0d6155b47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:16.326582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 828/1689] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:16.419321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bf46b-e3d5-4350-bfb6-824f6af51e50 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:16.421659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a26bf46b-e3d5-4350-bfb6-824f6af51e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:16.460458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bf46b-e3d5-4350-bfb6-824f6af51e50 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:16.547630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61442cf1-58bc-415f-ae3f-29216fad8532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:16.554290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442cf1-58bc-415f-ae3f-29216fad8532 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:16.557004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442cf1-58bc-415f-ae3f-29216fad8532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:16.557434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442cf1-58bc-415f-ae3f-29216fad8532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:16.600037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442cf1-58bc-415f-ae3f-29216fad8532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:16.607211 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442cf1-58bc-415f-ae3f-29216fad8532 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:16.638304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 862/1690] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:16.752082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:16.753571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:16.754100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:16.800770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] MFA Rules not processed for user `fbe6cc242fbf40cf8250dabaa336f648`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:16.808963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:16.856256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 829/1691] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:16.978529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa7ee-3848-4598-976c-7f556342b5e9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:16.978815 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa7ee-3848-4598-976c-7f556342b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:16.979281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaa7ee-3848-4598-976c-7f556342b5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:17.021476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-fbaaa7ee-3848-4598-976c-7f556342b5e9 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:17.023736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fbaaa7ee-3848-4598-976c-7f556342b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:17.197467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 863/1692] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:17.643848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:17.646259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:17.817973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936a5b1-0081-4e51-a1e7-eff879727cbb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:17.847726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefb140-27d2-466f-a8a6-4fe397589c52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:17.848643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefb140-27d2-466f-a8a6-4fe397589c52 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:17.857499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefb140-27d2-466f-a8a6-4fe397589c52 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:17.857979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefb140-27d2-466f-a8a6-4fe397589c52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:17.883600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefb140-27d2-466f-a8a6-4fe397589c52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:17.895057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefb140-27d2-466f-a8a6-4fe397589c52 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:17.934579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 830/1693] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 14:54:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:54:18.541701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe914-8cc2-45ae-a936-d7152c16ffb4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:18.542131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe914-8cc2-45ae-a936-d7152c16ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:18.542254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe914-8cc2-45ae-a936-d7152c16ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:18.616554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9dafe914-8cc2-45ae-a936-d7152c16ffb4 None None] MFA Rules not processed for user `1ded6e90b10949dcb921119073f2d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:18.617784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9dafe914-8cc2-45ae-a936-d7152c16ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:18.693268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 864/1694] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:19.030512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:19.031553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:19.032368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:19.119263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] MFA Rules not processed for user `18907451ac014573ba51f5f5f3939381`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:19.125199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:19.155378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 831/1695] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:19.181645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:19.181936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:19.182209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:19.255647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] MFA Rules not processed for user `81e8247739e24fcd9b067f1aa1cb9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:19.257962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:19.296501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 865/1696] 10.222.0.104 () {58 vars in 1016 bytes} [Fri May 13 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:19.311620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:19.313458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:19.345633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63c6e1-190f-47bc-8225-231d5bba361e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:19.363680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fb134-aa56-4faa-af39-be552aa8dfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:19.369147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fb134-aa56-4faa-af39-be552aa8dfbb service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:19.372199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fb134-aa56-4faa-af39-be552aa8dfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:19.373541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fb134-aa56-4faa-af39-be552aa8dfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:19.414759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fb134-aa56-4faa-af39-be552aa8dfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:19.421598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fb134-aa56-4faa-af39-be552aa8dfbb service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:19.487123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 832/1697] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:21.276491 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:21.280101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:21.586490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad785-bf12-4aaf-94db-0808a6661252 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:21.609528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:21.617085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:21.617636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:21.618316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] PATH_INFO: `/v3/users/ba46f93c5dc843e289122deb58d6e88c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:21.637723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba46f93c5dc843e289122deb58d6e88c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:21.647716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:21.832414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba46f93c5dc843e289122deb58d6e88c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:21.855258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba46f93c5dc843e289122deb58d6e88c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:21.900240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba46f93c5dc843e289122deb58d6e88c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:21.927921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba46f93c5dc843e289122deb58d6e88c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:21.929372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba46f93c5dc843e289122deb58d6e88c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:21.946387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 866/1698] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:21 2022] DELETE /identity/v3/users/ba46f93c5dc843e289122deb58d6e88c => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:21.951721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59c5a-56e2-4daa-9d7b-673d4dd52ec8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:21.952416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59c5a-56e2-4daa-9d7b-673d4dd52ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:21.955216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59c5a-56e2-4daa-9d7b-673d4dd52ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:22.002590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-74f59c5a-56e2-4daa-9d7b-673d4dd52ec8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:22.006457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74f59c5a-56e2-4daa-9d7b-673d4dd52ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:22.347150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 833/1699] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:22.418983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:22.420562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:22.585563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c5d85-6a42-422a-a802-656cc22abd85 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:22.599539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b87a43-6ab3-436e-a1c6-9ed15be66b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:22.600576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b87a43-6ab3-436e-a1c6-9ed15be66b6f service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:22.600966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b87a43-6ab3-436e-a1c6-9ed15be66b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:22.601343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b87a43-6ab3-436e-a1c6-9ed15be66b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:22.652969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b87a43-6ab3-436e-a1c6-9ed15be66b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:22.655997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b87a43-6ab3-436e-a1c6-9ed15be66b6f service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:22.730705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 867/1700] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:22.997911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899a1b-1c4d-4e41-8de7-3e3b3348c1d4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:23.000319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899a1b-1c4d-4e41-8de7-3e3b3348c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:23.000790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899a1b-1c4d-4e41-8de7-3e3b3348c1d4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:23.002716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 834/1701] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:54:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:23.025408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:23.026385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:23.026910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:23.066708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:23.068301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:23.271510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 868/1702] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:54:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:24.903987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899a1b-1c4d-4e41-8de7-3e3b3348c1d4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:24.907681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b6899a1b-1c4d-4e41-8de7-3e3b3348c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:25.000785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899a1b-1c4d-4e41-8de7-3e3b3348c1d4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.009729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.010412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.010672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.011187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.034571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.037692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.083964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.085555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:25.101270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 835/1703] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:25.102458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.109047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:25.115411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6edb0-6f81-4f05-a813-3fb0a7fa2db6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.144130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.145275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.146090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.146569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] PATH_INFO: `/v3/projects/b18e153d167d499f9c09afe833fb86ad` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.149364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18e153d167d499f9c09afe833fb86ad)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.151583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.168038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ae6d6-7cc8-4a44-98b7-42c4998c21a8 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.186086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.187181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.187617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.188092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] PATH_INFO: `/v3/users/2578ccb10b284a49a5336f9eb57f3cc4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.203832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2578ccb10b284a49a5336f9eb57f3cc4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.211932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.331802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18e153d167d499f9c09afe833fb86ad', 'request_id': 'req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.344236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18e153d167d499f9c09afe833fb86ad', 'request_id': 'req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.354643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2578ccb10b284a49a5336f9eb57f3cc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.382700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18e153d167d499f9c09afe833fb86ad', 'request_id': 'req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.400469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2578ccb10b284a49a5336f9eb57f3cc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.415337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2578ccb10b284a49a5336f9eb57f3cc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.441766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] The token cache is being invalidate because project b18e153d167d499f9c09afe833fb86ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:25.448871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.452308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.460561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 869/1704] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:25 2022] DELETE /identity/v3/projects/b18e153d167d499f9c09afe833fb86ad => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:25.480950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2578ccb10b284a49a5336f9eb57f3cc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.483729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d51268af-03ca-4c96-8dae-4c2c8e82e81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2578ccb10b284a49a5336f9eb57f3cc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:25.484654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.486455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:25.541396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 836/1705] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:25 2022] DELETE /identity/v3/users/2578ccb10b284a49a5336f9eb57f3cc4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:25.549735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.550281 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.550922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.633703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:25.640970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:25.728428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838a13-fd1c-4d82-a6d9-d651d0e7b52a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.903729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 837/1706] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:25.959366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.967454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.967777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.968217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] PATH_INFO: `/v3/users/f8725f8097e844c8b549390f597004cc` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.973048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8725f8097e844c8b549390f597004cc)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.977165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:26.028614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:26.031057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:26.176827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8725f8097e844c8b549390f597004cc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:26.209222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dbdfd-2308-4fb2-902f-d9edb317e674 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:26.219486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8725f8097e844c8b549390f597004cc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:26.220568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:26.221603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:26.222312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:26.227328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:26.248983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:26.256915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:26.286205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 838/1707] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:26.314328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8725f8097e844c8b549390f597004cc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:26.373707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8725f8097e844c8b549390f597004cc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:26.378802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8640d0dd-ca5f-4d80-8891-4ad143af8702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8725f8097e844c8b549390f597004cc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:26.420947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 870/1708] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:25 2022] DELETE /identity/v3/users/f8725f8097e844c8b549390f597004cc => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:27.880690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:27.903271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096c31-c695-44de-b2fd-e5869bb6e9bc service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:28.078006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:28.078869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.079560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.079835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] PATH_INFO: `/v3/projects/e0965b1521c648daae7118d73325b410` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.082827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0965b1521c648daae7118d73325b410)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:28.085759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:28.220444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0965b1521c648daae7118d73325b410', 'request_id': 'req-581290c8-1950-4152-a2a1-88e9cf01bfcd'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:28.245626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0965b1521c648daae7118d73325b410', 'request_id': 'req-581290c8-1950-4152-a2a1-88e9cf01bfcd'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:28.261891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0965b1521c648daae7118d73325b410', 'request_id': 'req-581290c8-1950-4152-a2a1-88e9cf01bfcd'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:28.287127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] The token cache is being invalidate because project e0965b1521c648daae7118d73325b410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:28.287762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:28.289017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-581290c8-1950-4152-a2a1-88e9cf01bfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:28.297304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 839/1709] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:27 2022] DELETE /identity/v3/projects/e0965b1521c648daae7118d73325b410 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:28.303504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dfda0-10f5-4234-9416-5a65180e7727 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.304105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dfda0-10f5-4234-9416-5a65180e7727 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.304105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dfda0-10f5-4234-9416-5a65180e7727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.366711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e17dfda0-10f5-4234-9416-5a65180e7727 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:28.370422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e17dfda0-10f5-4234-9416-5a65180e7727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:28.553934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 871/1710] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:28.562227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454b112-3e4c-47ce-b9df-7ef1bf0876d0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.563642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454b112-3e4c-47ce-b9df-7ef1bf0876d0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.564786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454b112-3e4c-47ce-b9df-7ef1bf0876d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.632071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1454b112-3e4c-47ce-b9df-7ef1bf0876d0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:28.633818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1454b112-3e4c-47ce-b9df-7ef1bf0876d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:28.672523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 840/1711] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:28.674865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dfda0-10f5-4234-9416-5a65180e7727 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:28.694885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dfda0-10f5-4234-9416-5a65180e7727 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:28.707424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:28.716633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.717041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.718954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.721093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:28.721788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:28.728327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:28.804096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 872/1712] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:28.809052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454b112-3e4c-47ce-b9df-7ef1bf0876d0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:28.841001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454b112-3e4c-47ce-b9df-7ef1bf0876d0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:28.863090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:28.863827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.864136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.864418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.869443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:28.883773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:28.946959 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 841/1713] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:28 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:28.951801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:28.969182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d15e74-fc28-4163-be85-f8b61c31f0ed admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.127835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.128595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.128880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.129163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.129872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.131851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.212451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 873/1714] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:28 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:29.215199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.217582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:29.225617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.266335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5376-a420-47ac-8195-6a607323252e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.272529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882fb7c-d1a1-446e-8988-a0e793091e32 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.285884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.290304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.291501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.292668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] PATH_INFO: `/v3/projects/1f1f4557b8bd4360ae6eb609fcd7f2ce` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.296332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1f4557b8bd4360ae6eb609fcd7f2ce)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.297301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.299961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.301726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.302152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.303058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.303421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.309582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.363686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 874/1715] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:29.368513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.394283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02335194-0cc4-45d9-a491-2ce7e7fa53f5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.421445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.426117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.427273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.428201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.431369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.434248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.465436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 875/1716] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:29.488537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.488687 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1f4557b8bd4360ae6eb609fcd7f2ce', 'request_id': 'req-6bf4941b-65b7-4b07-b359-9abeecfd44c5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:29.507906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1f4557b8bd4360ae6eb609fcd7f2ce', 'request_id': 'req-6bf4941b-65b7-4b07-b359-9abeecfd44c5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:29.554415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1f4557b8bd4360ae6eb609fcd7f2ce', 'request_id': 'req-6bf4941b-65b7-4b07-b359-9abeecfd44c5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:29.574194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] The token cache is being invalidate because project 1f1f4557b8bd4360ae6eb609fcd7f2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:29.574684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:29.578176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bf4941b-65b7-4b07-b359-9abeecfd44c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:29.583283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7b574-9ccd-4c08-bb2d-e0add835d834 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.592167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 842/1717] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:29 2022] DELETE /identity/v3/projects/1f1f4557b8bd4360ae6eb609fcd7f2ce => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:29.595778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd77e-b1ed-4556-9fea-ded6b1dba09d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.597482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd77e-b1ed-4556-9fea-ded6b1dba09d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.600319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd77e-b1ed-4556-9fea-ded6b1dba09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.663377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a50dd77e-b1ed-4556-9fea-ded6b1dba09d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:29.666071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a50dd77e-b1ed-4556-9fea-ded6b1dba09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:29.904567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9555-cf8b-4ed0-b965-9fecb66f8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.905683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9555-cf8b-4ed0-b965-9fecb66f8bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.910943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9555-cf8b-4ed0-b965-9fecb66f8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.911420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9555-cf8b-4ed0-b965-9fecb66f8bf1 admin admin] PATH_INFO: `/v3/projects/9f4e65629fcf4f12b83b20c122383ee3/users/133129bd689b47a683f786cf732e7f46/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.924116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 843/1718] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:29.926265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e25e51-8afc-4e0b-b48d-77680635cb51 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.928667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e25e51-8afc-4e0b-b48d-77680635cb51 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.936135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e25e51-8afc-4e0b-b48d-77680635cb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.963317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9555-cf8b-4ed0-b965-9fecb66f8bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4e65629fcf4f12b83b20c122383ee3, user_id=133129bd689b47a683f786cf732e7f46, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.966042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9555-cf8b-4ed0-b965-9fecb66f8bf1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.000600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-47e25e51-8afc-4e0b-b48d-77680635cb51 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:30.006679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 876/1719] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:29 2022] PUT /identity/v3/projects/9f4e65629fcf4f12b83b20c122383ee3/users/133129bd689b47a683f786cf732e7f46/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:30.007575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-47e25e51-8afc-4e0b-b48d-77680635cb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:30.008307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.008676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.012687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.087521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] MFA Rules not processed for user `133129bd689b47a683f786cf732e7f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:30.089117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:30.251922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 844/1720] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:30.253421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e25e51-8afc-4e0b-b48d-77680635cb51 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.261218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 877/1721] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:30.262226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.269478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:30.278273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e25e51-8afc-4e0b-b48d-77680635cb51 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.291899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.293273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.293925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.294506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.295481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:30.297490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.304295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.320272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03511d-98cc-46e4-bbbe-4d2764b3f90b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.339846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 845/1722] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:30.342420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.344640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.348928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.349348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.349733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.351074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.355296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.366380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4620e3-10f4-43e0-b568-0dad3622e99f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.390406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.391476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.392426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.392899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.393789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.397288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.454217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 878/1723] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:30 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:30.456642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.476221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 846/1724] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:30 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:30.477226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.672423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305145b-6d4d-4deb-99a5-22d3727514e3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.683655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81715a5-693f-45fd-a26a-d70fc14d3d4b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.687928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.693179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.693667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.694080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.695213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.698873 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.700056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.700056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.700366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.701064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.701722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.703601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.750110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 847/1725] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:30 2022] POST /identity/v3/users => generated 284 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:30.755968 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.772183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe58dd-a402-47ef-a023-d85826bd12ca admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.778217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.779707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.780117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.780678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 879/1726] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:30 2022] POST /identity/v3/users => generated 300 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:30.783771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.783771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.784704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.784911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.800679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50131-cd98-4713-9ec1-b00f7d3ae494 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.816369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.816958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.817581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.817868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.819082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.820316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.828382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 848/1727] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:30.829393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.841633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456a7ad-946e-423a-8fec-b45b8c00a78b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.843602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 880/1728] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:30.855474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.865292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.866010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.866252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.866529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.867264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.868960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.895758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229305d-e065-4713-ab8f-122017ee9e01 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.917015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.917795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 849/1729] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:30.918407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.918949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.919344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] PATH_INFO: `/v3/projects/c6afdcf88b764219b30dab85a7d11546/users/736a1fe1175f40f0a4637728ef1592af/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.924612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.948206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6afdcf88b764219b30dab85a7d11546, user_id=736a1fe1175f40f0a4637728ef1592af, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.953584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.957849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f860e-d8f1-4309-a0cc-cb9edd919530 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.993521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7c166-72e8-418f-a85d-2e4ad5f93c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.994789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c166-72e8-418f-a85d-2e4ad5f93c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.995252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c166-72e8-418f-a85d-2e4ad5f93c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.997738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c166-72e8-418f-a85d-2e4ad5f93c19 admin admin] PATH_INFO: `/v3/projects/1c8c8b103ea34e7a8aa626b3610ab326/users/7e1f66423ec14f6293e54c22520fe637/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.003429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 881/1730] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:30 2022] PUT /identity/v3/projects/c6afdcf88b764219b30dab85a7d11546/users/736a1fe1175f40f0a4637728ef1592af/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:31.007252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:31.069747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c166-72e8-418f-a85d-2e4ad5f93c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8c8b103ea34e7a8aa626b3610ab326, user_id=7e1f66423ec14f6293e54c22520fe637, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:31.072648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c166-72e8-418f-a85d-2e4ad5f93c19 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:31.092889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58042e4-ff2d-43a1-a6f1-31a6ca5a18a0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:31.101557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:31.103762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:31.104092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:31.104422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.105303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:31.114012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:31.134612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 850/1731] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:30 2022] PUT /identity/v3/projects/1c8c8b103ea34e7a8aa626b3610ab326/users/7e1f66423ec14f6293e54c22520fe637/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:31.148652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625fca-5421-4f27-8733-f58614166bc4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:31.149163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625fca-5421-4f27-8733-f58614166bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:31.149613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625fca-5421-4f27-8733-f58614166bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.152249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 882/1732] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:31.157946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:31.172119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0fe85-3127-4077-abc3-4187a155eec6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:31.250796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-51625fca-5421-4f27-8733-f58614166bc4 None None] MFA Rules not processed for user `7e1f66423ec14f6293e54c22520fe637`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:31.252640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-51625fca-5421-4f27-8733-f58614166bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:31.313060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9770-1e04-4091-9bf5-f3a08d13ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:31.314626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9770-1e04-4091-9bf5-f3a08d13ec74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:31.316757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9770-1e04-4091-9bf5-f3a08d13ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:31.317309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9770-1e04-4091-9bf5-f3a08d13ec74 admin admin] PATH_INFO: `/v3/projects/c6afdcf88b764219b30dab85a7d11546/users/736a1fe1175f40f0a4637728ef1592af/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.324715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9770-1e04-4091-9bf5-f3a08d13ec74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6afdcf88b764219b30dab85a7d11546, user_id=736a1fe1175f40f0a4637728ef1592af, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:31.338411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9770-1e04-4091-9bf5-f3a08d13ec74 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:31.381840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 883/1733] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:31 2022] PUT /identity/v3/projects/c6afdcf88b764219b30dab85a7d11546/users/736a1fe1175f40f0a4637728ef1592af/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:31.394278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:31.396797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:31.397458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.457330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] MFA Rules not processed for user `736a1fe1175f40f0a4637728ef1592af`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:31.458921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:31.484072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 851/1734] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:31.488195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625fca-5421-4f27-8733-f58614166bc4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:31.522684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625fca-5421-4f27-8733-f58614166bc4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:31.637462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 884/1735] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:31.651435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:31.653835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:31.677876 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:31.678534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:31.679004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:31.679489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.680203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:31.683595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:31.742405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 852/1736] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:31 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:31.749627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:31.754966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c611dc-fc69-48e2-9beb-61f52e52374e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:32.017221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:32.017940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.018226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.018506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.021730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc4d5c-ff28-4a8e-896c-cbf3519e9032 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:32.030505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:32.031218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.031556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.031779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.032521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:32.044695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:32.085190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 853/1737] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:31 2022] POST /identity/v3/users => generated 289 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:32.088935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:32.109624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ad3e9-764d-4e0d-b7e2-9bde3892219b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:32.132705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:32.133412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.133695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.133975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.134872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:32.136565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:32.178166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 854/1738] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:32.181144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:32.195750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:32.197679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:32.214448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c967e78-a579-4f7b-a57b-81698bf33dc3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:32.227708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 885/1739] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:32.230295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:32.231408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.231967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.232449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] PATH_INFO: `/v3/projects/a0479c9d2c52447b8409b09f5a932d1f/users/e6906d7671db49eb9e5bf05ea70e2254/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.251131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0479c9d2c52447b8409b09f5a932d1f, user_id=e6906d7671db49eb9e5bf05ea70e2254, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:32.266333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:32.291522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:32.292098 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 855/1740] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:32 2022] PUT /identity/v3/projects/a0479c9d2c52447b8409b09f5a932d1f/users/e6906d7671db49eb9e5bf05ea70e2254/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:32.298126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:32.312942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75f26f-8c20-464f-8aa0-7e04373f098f service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:32.402849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:32.404071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.405830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.408653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] PATH_INFO: `/v3/users/133129bd689b47a683f786cf732e7f46` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.411945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=133129bd689b47a683f786cf732e7f46)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:32.417215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:32.474322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bac6c2-0f91-477e-aa50-b38addae18e3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:32.490423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:32.491157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.491404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.491681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.495319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133129bd689b47a683f786cf732e7f46'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:32.499037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:32.504780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:32.518290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133129bd689b47a683f786cf732e7f46'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:32.538479 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 856/1741] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:32.542977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:32.552288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133129bd689b47a683f786cf732e7f46'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:32.562234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133129bd689b47a683f786cf732e7f46'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:32.563272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4744b234-0163-449c-b50c-b22006d17aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133129bd689b47a683f786cf732e7f46'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:32.574263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 886/1742] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:32 2022] DELETE /identity/v3/users/133129bd689b47a683f786cf732e7f46 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:32.582310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f4f8-49e2-47ac-816e-f2fb1ab20dc2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.583183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f4f8-49e2-47ac-816e-f2fb1ab20dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.584468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f4f8-49e2-47ac-816e-f2fb1ab20dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.658667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307aa8c-04f7-4164-9583-4ed68f864874 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:32.661144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9a12f4f8-49e2-47ac-816e-f2fb1ab20dc2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:32.662616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9a12f4f8-49e2-47ac-816e-f2fb1ab20dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:32.851893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 887/1743] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:32.934041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:32.935207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.935545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.935973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] PATH_INFO: `/v3/projects/a0479c9d2c52447b8409b09f5a932d1f/users/e6906d7671db49eb9e5bf05ea70e2254/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:32.938984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0479c9d2c52447b8409b09f5a932d1f, user_id=e6906d7671db49eb9e5bf05ea70e2254, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:32.941960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:32.963805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 857/1744] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:32 2022] PUT /identity/v3/projects/a0479c9d2c52447b8409b09f5a932d1f/users/e6906d7671db49eb9e5bf05ea70e2254/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:32.978258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:32.978258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:32.978258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:33.049060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] MFA Rules not processed for user `e6906d7671db49eb9e5bf05ea70e2254`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:33.051600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:33.073032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:33.075992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:33.215257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eaf37-6b17-41e3-a9a8-dc8932b9161d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:33.227615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 888/1745] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:33.233477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:33.234487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:33.234819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:33.235107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:33.246657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:33.251511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:33.456669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:33.465084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:33.474581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4043c-18eb-42ed-ada6-7ae73816e0f4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:33.489676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:33.493036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:33.494442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:33.495761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:33.516334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 858/1746] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:33.533241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:33.536173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:33.562915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 889/1747] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:33.726601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:33.737789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df2676-2540-4420-98ee-e4c359794da5 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:33.743006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d97d-70db-4095-94e5-6ef0039b996c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:33.743747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d97d-70db-4095-94e5-6ef0039b996c service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:33.744070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d97d-70db-4095-94e5-6ef0039b996c service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:33.744350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d97d-70db-4095-94e5-6ef0039b996c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:33.746293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8c42d97d-70db-4095-94e5-6ef0039b996c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:33.885026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d97d-70db-4095-94e5-6ef0039b996c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:33.887261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d97d-70db-4095-94e5-6ef0039b996c service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:33.937562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 859/1748] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:34.410790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:34.412275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:34.438197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fce85-e553-4e0e-90fe-f65587abb4e2 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:34.444582 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:34.445444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:34.445730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:34.446004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] PATH_INFO: `/v3/users/32f28389142942b9b3721f7ebe1e8889` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:34.448042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f28389142942b9b3721f7ebe1e8889)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:34.450229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:34.516242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f28389142942b9b3721f7ebe1e8889'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.525308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f28389142942b9b3721f7ebe1e8889'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.540261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f28389142942b9b3721f7ebe1e8889'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.549569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f28389142942b9b3721f7ebe1e8889'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.550862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f28389142942b9b3721f7ebe1e8889'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.568352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 890/1749] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:34 2022] DELETE /identity/v3/users/32f28389142942b9b3721f7ebe1e8889 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:34.569300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:34.569838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:34.569928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:34.595517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:34.596893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:34.687463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 860/1750] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:34.703944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:34.706959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:34.805208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674007d-4f83-4137-9e71-12475f9d861c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:34.811734 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:34.812684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:34.813177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:34.813595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:34.827899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:34.829386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:34.837923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:34.841654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:34.853077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3b054-757d-49a0-8ebe-08641674a3cb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:34.880605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:34.881877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:34.883614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:34.884068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] PATH_INFO: `/v3/projects/9f4e65629fcf4f12b83b20c122383ee3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:34.884740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 891/1751] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:34.885811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4e65629fcf4f12b83b20c122383ee3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:34.888647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:34.945844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4e65629fcf4f12b83b20c122383ee3', 'request_id': 'req-81b5990e-578c-44b5-be84-d37e85186437'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.961585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4e65629fcf4f12b83b20c122383ee3', 'request_id': 'req-81b5990e-578c-44b5-be84-d37e85186437'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.971383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4e65629fcf4f12b83b20c122383ee3', 'request_id': 'req-81b5990e-578c-44b5-be84-d37e85186437'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.989101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] The token cache is being invalidate because project 9f4e65629fcf4f12b83b20c122383ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:34.989574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.991430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:34.993947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 861/1752] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:34 2022] DELETE /identity/v3/projects/9f4e65629fcf4f12b83b20c122383ee3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:34.997965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:35.009082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3697802-e39f-400e-8cf9-a3b081a7b0a1 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:35.098059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:35.099630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:35.100296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:35.100800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] PATH_INFO: `/v3/users/736a1fe1175f40f0a4637728ef1592af` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:35.102414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736a1fe1175f40f0a4637728ef1592af)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:35.105883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:35.216201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736a1fe1175f40f0a4637728ef1592af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.237545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736a1fe1175f40f0a4637728ef1592af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.268504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736a1fe1175f40f0a4637728ef1592af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.288799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736a1fe1175f40f0a4637728ef1592af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.290547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736a1fe1175f40f0a4637728ef1592af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.302692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 892/1753] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:34 2022] DELETE /identity/v3/users/736a1fe1175f40f0a4637728ef1592af => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:35.466440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:35.468260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:35.484410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5990e-578c-44b5-be84-d37e85186437 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:35.559749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:35.561307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:35.561771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:35.562141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] PATH_INFO: `/v3/projects/a849983cefb9409db7c0af498a43f300` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:35.564168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a849983cefb9409db7c0af498a43f300)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:35.566425 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:35.657349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a849983cefb9409db7c0af498a43f300', 'request_id': 'req-8d94734c-e2d4-4f87-84e0-fe2fe039648b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.671682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a849983cefb9409db7c0af498a43f300', 'request_id': 'req-8d94734c-e2d4-4f87-84e0-fe2fe039648b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.687175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a849983cefb9409db7c0af498a43f300', 'request_id': 'req-8d94734c-e2d4-4f87-84e0-fe2fe039648b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.704832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] The token cache is being invalidate because project a849983cefb9409db7c0af498a43f300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:35.705428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.706234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.708116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 862/1754] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:35 2022] DELETE /identity/v3/projects/a849983cefb9409db7c0af498a43f300 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:35.712084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:35.713876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:35.730071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:35.732618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:35.738128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b282f-8067-4a47-9c86-db8d8cb854c2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:35.857912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:35.859205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:35.859570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:35.859941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] PATH_INFO: `/v3/users/504b97856c9a4e0ba1aeb02eb64d9aad` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:35.861365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=504b97856c9a4e0ba1aeb02eb64d9aad)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:35.863937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:35.873884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94734c-e2d4-4f87-84e0-fe2fe039648b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:35.883229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:35.884143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:35.884497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:35.884696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] PATH_INFO: `/v3/projects/c6afdcf88b764219b30dab85a7d11546` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:35.891990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6afdcf88b764219b30dab85a7d11546)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:35.905780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:35.952678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504b97856c9a4e0ba1aeb02eb64d9aad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.969593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504b97856c9a4e0ba1aeb02eb64d9aad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.985787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504b97856c9a4e0ba1aeb02eb64d9aad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.994443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504b97856c9a4e0ba1aeb02eb64d9aad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:35.995218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ea87851-5b13-43af-9efc-13b9cef1df2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504b97856c9a4e0ba1aeb02eb64d9aad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.003010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 893/1755] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:35 2022] DELETE /identity/v3/users/504b97856c9a4e0ba1aeb02eb64d9aad => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:36.004348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5465746-f23c-4047-ac4e-e704a2e1e4db None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.004701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5465746-f23c-4047-ac4e-e704a2e1e4db None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.004986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5465746-f23c-4047-ac4e-e704a2e1e4db None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.006710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 894/1756] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:36.128164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6afdcf88b764219b30dab85a7d11546', 'request_id': 'req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.135171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6afdcf88b764219b30dab85a7d11546', 'request_id': 'req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.144715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6afdcf88b764219b30dab85a7d11546', 'request_id': 'req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.157442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] The token cache is being invalidate because project c6afdcf88b764219b30dab85a7d11546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:36.157734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.159105 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c8d9905-607c-43c9-9e88-50d4f3e3eae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.160297 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec097-158c-4605-92a6-ab88287655a5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.160597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec097-158c-4605-92a6-ab88287655a5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.160880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec097-158c-4605-92a6-ab88287655a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.161278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 863/1757] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:35 2022] DELETE /identity/v3/projects/c6afdcf88b764219b30dab85a7d11546 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:36.169130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f752-e292-4239-aac9-947c965da301 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.169529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f752-e292-4239-aac9-947c965da301 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.170682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f752-e292-4239-aac9-947c965da301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.186797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2faec097-158c-4605-92a6-ab88287655a5 None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:36.188464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2faec097-158c-4605-92a6-ab88287655a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.211621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b523f752-e292-4239-aac9-947c965da301 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:36.213126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b523f752-e292-4239-aac9-947c965da301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.300611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 864/1758] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:36.308830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.309354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.309845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.327663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 895/1759] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:36.332441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:36.333669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.346081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 865/1760] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:36.348018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec097-158c-4605-92a6-ab88287655a5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.361976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.365196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.370771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec097-158c-4605-92a6-ab88287655a5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.389967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.391416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.391416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.391685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.392498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:36.392806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.394614 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.398801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0321be-1fea-4707-82a3-5958f2b5956c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.407448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.408444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.411829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 896/1761] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:36.412319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.412771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] PATH_INFO: `/v3/projects/07d0b0d0bdab42fdb9c2b68b46454926` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.412874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.414096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d0b0d0bdab42fdb9c2b68b46454926)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.416071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.424723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f9aaf-bb99-4bf4-84e3-df1733bc5658 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.440024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.440802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.441153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.441506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.442287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.445940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.493515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d0b0d0bdab42fdb9c2b68b46454926', 'request_id': 'req-494a6887-e74a-4462-8d6b-4dc06cd9c74e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.501275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d0b0d0bdab42fdb9c2b68b46454926', 'request_id': 'req-494a6887-e74a-4462-8d6b-4dc06cd9c74e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.503342 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 897/1762] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:36.506262 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.520104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d0b0d0bdab42fdb9c2b68b46454926', 'request_id': 'req-494a6887-e74a-4462-8d6b-4dc06cd9c74e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.536813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] The token cache is being invalidate because project 07d0b0d0bdab42fdb9c2b68b46454926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:36.537394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.538459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-494a6887-e74a-4462-8d6b-4dc06cd9c74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:36.540691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 866/1763] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:36 2022] DELETE /identity/v3/projects/07d0b0d0bdab42fdb9c2b68b46454926 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:36.547430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.547723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.548050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.569621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:36.570848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.603091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36efc8e-9cdb-41c0-99bc-9a1dcd684c36 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.608967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.609864 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.610149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.610810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.611774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.613762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.656757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 898/1764] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:36.659681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.664200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.690279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 867/1765] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:36.690279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.691213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6a6cf-443a-4b57-afd4-c55c59bf9edc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.692206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.702137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52a2c-cad5-4a2d-b31a-feb3811a1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.704027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52a2c-cad5-4a2d-b31a-feb3811a1b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.705411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52a2c-cad5-4a2d-b31a-feb3811a1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.705909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52a2c-cad5-4a2d-b31a-feb3811a1b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.706636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52a2c-cad5-4a2d-b31a-feb3811a1b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.708361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52a2c-cad5-4a2d-b31a-feb3811a1b0d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.720227 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 899/1766] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:36.721661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b68c45-addb-4b80-bbc5-801a7fe3ca2e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.721954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b68c45-addb-4b80-bbc5-801a7fe3ca2e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.722231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b68c45-addb-4b80-bbc5-801a7fe3ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.742915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-71b68c45-addb-4b80-bbc5-801a7fe3ca2e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:36.744249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-71b68c45-addb-4b80-bbc5-801a7fe3ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.756613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 900/1767] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:36.756613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b68c45-addb-4b80-bbc5-801a7fe3ca2e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.766761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b68c45-addb-4b80-bbc5-801a7fe3ca2e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.771711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.772480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.772817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.773101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.773841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.775499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.787784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 901/1768] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:36.789171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.801363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce889-d207-4055-bbf4-0744e09d45f6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.806710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.807747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.808163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.808540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.809430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:36.810175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.813290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.826667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 902/1769] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:36.827516 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.842624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d14d-cb5c-4ac3-bb94-4e8e317495dc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.845340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b843d1-633e-42eb-ad4b-aa336b9b4d10 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.855319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc034c9-4d93-4d9b-b9fb-bb91a3bd79dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.857269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc034c9-4d93-4d9b-b9fb-bb91a3bd79dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.858975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc034c9-4d93-4d9b-b9fb-bb91a3bd79dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.859266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:36.861338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc034c9-4d93-4d9b-b9fb-bb91a3bd79dd admin admin] PATH_INFO: `/v3/projects/edd65b5deda44abc8d95c4f1a7fc8614/users/4c1188a2370c4587acdd7fa962f9edd6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.861470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.861821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.862375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.882176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.912478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.914494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.919575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc034c9-4d93-4d9b-b9fb-bb91a3bd79dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd65b5deda44abc8d95c4f1a7fc8614, user_id=4c1188a2370c4587acdd7fa962f9edd6, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:36.923669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc034c9-4d93-4d9b-b9fb-bb91a3bd79dd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:36.927842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 868/1770] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:36.928907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:36.945137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6576f3-45cb-42b4-b53d-c5136ad446a9 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:36.949990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 903/1771] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:36 2022] PUT /identity/v3/projects/edd65b5deda44abc8d95c4f1a7fc8614/users/4c1188a2370c4587acdd7fa962f9edd6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:36.965126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a06b-f32d-49b0-98da-4931b1209427 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.966107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a06b-f32d-49b0-98da-4931b1209427 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.966585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a06b-f32d-49b0-98da-4931b1209427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.000839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-99b5a06b-f32d-49b0-98da-4931b1209427 None None] MFA Rules not processed for user `4c1188a2370c4587acdd7fa962f9edd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:37.002124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-99b5a06b-f32d-49b0-98da-4931b1209427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:37.041647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.042771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.043241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.043694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.045027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.047284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.079118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 904/1772] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:37.083072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a06b-f32d-49b0-98da-4931b1209427 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.087146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 869/1773] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:37.088425 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.097796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a06b-f32d-49b0-98da-4931b1209427 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.163682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.164687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.164972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.165244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.165946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.168062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.183916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed912f-5b0c-4523-a4af-123100d873be admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.189543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.190392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.190826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.191249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.192194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.194468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.205607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 905/1774] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:37 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:37.209735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.222614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 870/1775] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:37 2022] POST /identity/v3/users => generated 282 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:37.226937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.239620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae89-4b30-4be0-b1ea-f9a4823e19af admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.282609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bbba5-1068-405f-8633-dfd17f8732e6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.291458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.292649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.293215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.293633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.294886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.298392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.304632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.305444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.305804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.306205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.307008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.309003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.322637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 906/1776] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:37 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:37.327477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.333282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 871/1777] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:37.338915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6005cd2-e3e3-46fe-8c98-99e44638dad0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.340221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.344235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.344994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.345557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.345895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.347503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.350032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.351020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bc81-c4a2-425b-b2f7-c158796440c4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.361811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.362638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.363015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.363380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.364247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.366001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.368157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 907/1778] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:37.369245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.379911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 872/1779] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:37.380065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5411ba-0857-4d19-9e03-a46406ffde97 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.382528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.386041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.386966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.387247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.387523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] PATH_INFO: `/v3/projects/85b8f8cada2d4a2584683436656d8c55/users/5fee72f157c949b7808fdd7db5c6082a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.392599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb99b6-dea3-4bd5-8396-4b7a0479ec46 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.402028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407a655-b89f-4f7b-998c-94ffae5f8b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.403327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a655-b89f-4f7b-998c-94ffae5f8b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.403327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a655-b89f-4f7b-998c-94ffae5f8b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.403911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a655-b89f-4f7b-998c-94ffae5f8b51 admin admin] PATH_INFO: `/v3/projects/7b420b210bbd49c48388d6fc5d76e062/users/afd0f67d035b4eb69ddfb62afac7f9ad/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.407615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b8f8cada2d4a2584683436656d8c55, user_id=5fee72f157c949b7808fdd7db5c6082a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.410422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.426530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407a655-b89f-4f7b-998c-94ffae5f8b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b420b210bbd49c48388d6fc5d76e062, user_id=afd0f67d035b4eb69ddfb62afac7f9ad, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.432046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407a655-b89f-4f7b-998c-94ffae5f8b51 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.433712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 908/1780] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:37 2022] PUT /identity/v3/projects/85b8f8cada2d4a2584683436656d8c55/users/5fee72f157c949b7808fdd7db5c6082a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:37.444408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.455336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 873/1781] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:37 2022] PUT /identity/v3/projects/7b420b210bbd49c48388d6fc5d76e062/users/afd0f67d035b4eb69ddfb62afac7f9ad/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:37.467138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d888-2583-4d29-8f57-3f95a178a944 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.467434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d888-2583-4d29-8f57-3f95a178a944 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.467694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d888-2583-4d29-8f57-3f95a178a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.502075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7266d888-2583-4d29-8f57-3f95a178a944 None None] MFA Rules not processed for user `afd0f67d035b4eb69ddfb62afac7f9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:37.503323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7266d888-2583-4d29-8f57-3f95a178a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:37.524301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a20599-86e7-48df-a76d-5e4ad0b541af admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.573362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 874/1782] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:37.578084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d888-2583-4d29-8f57-3f95a178a944 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.581266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.582017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.582415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.582761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.583735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.585824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.588972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d888-2583-4d29-8f57-3f95a178a944 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.594674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.595349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.595632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.595942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.596663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 909/1783] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:37.596782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.598925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.600780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.611194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a87f-3cad-48da-aed0-68733ba2be23 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.616306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2863-32db-4cef-b630-2acef9a244a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.617370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2863-32db-4cef-b630-2acef9a244a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.617888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2863-32db-4cef-b630-2acef9a244a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.618314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2863-32db-4cef-b630-2acef9a244a9 admin admin] PATH_INFO: `/v3/projects/85b8f8cada2d4a2584683436656d8c55/users/5fee72f157c949b7808fdd7db5c6082a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.620577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2863-32db-4cef-b630-2acef9a244a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b8f8cada2d4a2584683436656d8c55, user_id=5fee72f157c949b7808fdd7db5c6082a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.623421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2863-32db-4cef-b630-2acef9a244a9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.633989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 875/1784] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:37 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:37.634958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 910/1785] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:37 2022] PUT /identity/v3/projects/85b8f8cada2d4a2584683436656d8c55/users/5fee72f157c949b7808fdd7db5c6082a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:37.635416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.646344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.646636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.646919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.677027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] MFA Rules not processed for user `5fee72f157c949b7808fdd7db5c6082a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:37.678252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:37.700100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c1dd-5241-4a29-811d-38c916875b69 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.703885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.704578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.704856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.705130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.705823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.707794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.727819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 876/1786] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:37 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:37.731779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.742775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955831e-b9e8-4fe5-9576-8dd9711fa33b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.748972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.749662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.749946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.750222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.750963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.752739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.763392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 877/1787] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:37.767607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.772133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 911/1788] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:37.779447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.780996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:37.790267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135aee-ec2e-47b7-ac05-a05cd3a236d6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.796445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.797685 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.798173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.798453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] PATH_INFO: `/v3/projects/b06b61f02a7f49be95573cf97056e0e2/users/edc0af999c784959b19a0726fa694c29/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.817978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06b61f02a7f49be95573cf97056e0e2, user_id=edc0af999c784959b19a0726fa694c29, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.820895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.837375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 878/1789] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:37 2022] PUT /identity/v3/projects/b06b61f02a7f49be95573cf97056e0e2/users/edc0af999c784959b19a0726fa694c29/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:37.842630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.844747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc6946-7bcb-433d-9fd9-241e1570eac1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.907722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e648e98-aa57-46dc-964d-fc1720257b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.908833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648e98-aa57-46dc-964d-fc1720257b7b service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.909267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648e98-aa57-46dc-964d-fc1720257b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.909984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648e98-aa57-46dc-964d-fc1720257b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.939496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7608c-9d82-4f97-857a-5a2a5d6b4956 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.952841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.953780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.954524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.954524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.955418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.957312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.983624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 879/1790] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:37.984653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.997751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c9210-40a3-423b-a6d2-8a8e27e39f38 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.999459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e648e98-aa57-46dc-964d-fc1720257b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:38.001456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e648e98-aa57-46dc-964d-fc1720257b7b service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:38.014503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 912/1791] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:38.031788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:38.032870 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:38.033249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:38.033640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] PATH_INFO: `/v3/projects/b06b61f02a7f49be95573cf97056e0e2/users/edc0af999c784959b19a0726fa694c29/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:38.046721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06b61f02a7f49be95573cf97056e0e2, user_id=edc0af999c784959b19a0726fa694c29, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:38.051357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:38.078820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 880/1792] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:37 2022] PUT /identity/v3/projects/b06b61f02a7f49be95573cf97056e0e2/users/edc0af999c784959b19a0726fa694c29/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:38.095391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:38.095391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:38.095747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:38.147797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] MFA Rules not processed for user `edc0af999c784959b19a0726fa694c29`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:38.150710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:38.202670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:38.314531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4345f-0f69-4923-bf92-faa874ee0ad7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:38.318924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 913/1793] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:38.327712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:38.329009 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:38.329367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:38.329718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:38.383712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:38.385411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:38.405440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50e06-4b3b-4489-9adf-f46225c11e11 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:38.409900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:38.411084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:38.411445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:38.412618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:38.415701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:38.417814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:38.425593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:38.427795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:38.430947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 881/1794] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:38.440535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 914/1795] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:38.623052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:38.634444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e26d9-4f84-46c7-97c5-527f7b198c09 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:38.643280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a5cf2-6afb-4ea3-8b7a-4ddb772e5979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:38.643986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5cf2-6afb-4ea3-8b7a-4ddb772e5979 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:38.644274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5cf2-6afb-4ea3-8b7a-4ddb772e5979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:38.644550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5cf2-6afb-4ea3-8b7a-4ddb772e5979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:38.742225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a5cf2-6afb-4ea3-8b7a-4ddb772e5979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:38.744802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a5cf2-6afb-4ea3-8b7a-4ddb772e5979 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:38.760200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 882/1796] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:40.825831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:40.827405 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:40.896444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7205-020e-4b60-aaf3-52a80b668eec service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:40.901036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:40.901931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:40.902219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:40.902493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] PATH_INFO: `/v3/users/7e1f66423ec14f6293e54c22520fe637` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:40.903837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f66423ec14f6293e54c22520fe637)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:40.905855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:40.956175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f66423ec14f6293e54c22520fe637'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:40.965554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f66423ec14f6293e54c22520fe637'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:40.978854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f66423ec14f6293e54c22520fe637'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:40.985494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f66423ec14f6293e54c22520fe637'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:40.986183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f66423ec14f6293e54c22520fe637'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:40.992065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 915/1797] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:40 2022] DELETE /identity/v3/users/7e1f66423ec14f6293e54c22520fe637 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:40.996592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:40.997086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:40.997194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:41.015669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:41.017245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:41.076253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 883/1798] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:41.086333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:41.087786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:41.146874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd795e-fc6e-4f15-a649-b480ac8d12fd admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:41.150976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b43c7-ec60-4670-bec7-5829432b2c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:41.151736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b43c7-ec60-4670-bec7-5829432b2c8a service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:41.152135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b43c7-ec60-4670-bec7-5829432b2c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:41.152434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b43c7-ec60-4670-bec7-5829432b2c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:41.162145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b43c7-ec60-4670-bec7-5829432b2c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:41.163648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b43c7-ec60-4670-bec7-5829432b2c8a service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:41.174402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 916/1799] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:41.239595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:41.241238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:41.255809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d96298-b035-42ec-862c-27af9363da66 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:41.261132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:41.262023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:41.262312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:41.262583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] PATH_INFO: `/v3/users/4c1188a2370c4587acdd7fa962f9edd6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:41.264403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1188a2370c4587acdd7fa962f9edd6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:41.266372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:41.320132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1188a2370c4587acdd7fa962f9edd6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:41.332345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1188a2370c4587acdd7fa962f9edd6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:41.333134 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1188a2370c4587acdd7fa962f9edd6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:41.347302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1188a2370c4587acdd7fa962f9edd6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:41.348412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1188a2370c4587acdd7fa962f9edd6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:41.363775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 884/1800] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:41 2022] DELETE /identity/v3/users/4c1188a2370c4587acdd7fa962f9edd6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:41.368802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765159ca-988f-4dcd-88d9-4250d2185a6f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:41.369094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765159ca-988f-4dcd-88d9-4250d2185a6f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:41.369372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765159ca-988f-4dcd-88d9-4250d2185a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:41.389941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-765159ca-988f-4dcd-88d9-4250d2185a6f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:41.391189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-765159ca-988f-4dcd-88d9-4250d2185a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:41.465246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 917/1801] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:41.485849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:41.487117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:41.637377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e84a7d-62dc-460c-832c-aea6bb3f39ce admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:41.648318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc68c0-e9d8-49d1-b001-03cbd4e6b762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:41.650516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc68c0-e9d8-49d1-b001-03cbd4e6b762 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:41.653202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc68c0-e9d8-49d1-b001-03cbd4e6b762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:41.654910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc68c0-e9d8-49d1-b001-03cbd4e6b762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:41.680684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc68c0-e9d8-49d1-b001-03cbd4e6b762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:41.683333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc68c0-e9d8-49d1-b001-03cbd4e6b762 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:41.705256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 885/1802] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:42.272454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff175-f23d-48d1-8b59-511898a6de64 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.272454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff175-f23d-48d1-8b59-511898a6de64 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.272454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff175-f23d-48d1-8b59-511898a6de64 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.273979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 918/1803] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:42.341655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.342921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.343735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.376400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:42.378092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.412271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ff175-f23d-48d1-8b59-511898a6de64 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:42.423229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f78ff175-f23d-48d1-8b59-511898a6de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.453833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ff175-f23d-48d1-8b59-511898a6de64 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:42.466369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:42.467571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.469783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.479472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] PATH_INFO: `/v3/projects/1c8c8b103ea34e7a8aa626b3610ab326` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.481565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8c8b103ea34e7a8aa626b3610ab326)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:42.485325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:42.552221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 886/1804] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:54:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:42.553538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:42.555357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.573973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efd8e1-4ec8-40ef-bf1e-64faf419a560 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:42.580096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:42.581301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.581908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.582324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] PATH_INFO: `/v3/projects/edd65b5deda44abc8d95c4f1a7fc8614` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.585313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd65b5deda44abc8d95c4f1a7fc8614)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:42.587972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:42.664123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd65b5deda44abc8d95c4f1a7fc8614', 'request_id': 'req-74a73cad-e420-4eda-8c4b-98b5ae262a4e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.672063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd65b5deda44abc8d95c4f1a7fc8614', 'request_id': 'req-74a73cad-e420-4eda-8c4b-98b5ae262a4e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.682407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd65b5deda44abc8d95c4f1a7fc8614', 'request_id': 'req-74a73cad-e420-4eda-8c4b-98b5ae262a4e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.699003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] The token cache is being invalidate because project edd65b5deda44abc8d95c4f1a7fc8614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:42.699292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.699568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8c8b103ea34e7a8aa626b3610ab326', 'request_id': 'req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.700523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.703057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 887/1805] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:42 2022] DELETE /identity/v3/projects/edd65b5deda44abc8d95c4f1a7fc8614 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:42.708322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8c8b103ea34e7a8aa626b3610ab326', 'request_id': 'req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.710844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:42.713573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.719436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8c8b103ea34e7a8aa626b3610ab326', 'request_id': 'req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.740456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] The token cache is being invalidate because project 1c8c8b103ea34e7a8aa626b3610ab326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:42.740878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.741540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.743374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 919/1806] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:42 2022] DELETE /identity/v3/projects/1c8c8b103ea34e7a8aa626b3610ab326 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:42.744007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:42.745328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.789287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a73cad-e420-4eda-8c4b-98b5ae262a4e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:42.837633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b7286-93d6-4068-bce4-ccb8ed7d06f9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:42.844241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81395d-c174-4331-a594-ca55574294be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:42.844929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81395d-c174-4331-a594-ca55574294be service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.845209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81395d-c174-4331-a594-ca55574294be service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.845539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81395d-c174-4331-a594-ca55574294be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.847333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9c81395d-c174-4331-a594-ca55574294be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.856289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:42.857378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.857729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.858063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] PATH_INFO: `/v3/users/5fee72f157c949b7808fdd7db5c6082a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.859335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fee72f157c949b7808fdd7db5c6082a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:42.861426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:42.861711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81395d-c174-4331-a594-ca55574294be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:42.863423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81395d-c174-4331-a594-ca55574294be service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:42.874221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 920/1807] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:42.874893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81395d-c174-4331-a594-ca55574294be service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:42.876238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9c81395d-c174-4331-a594-ca55574294be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.896321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81395d-c174-4331-a594-ca55574294be service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:42.904343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:42.905473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.905755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.906035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] PATH_INFO: `/v3/users/e6906d7671db49eb9e5bf05ea70e2254` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.907307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6906d7671db49eb9e5bf05ea70e2254)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:42.909332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:42.915029 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fee72f157c949b7808fdd7db5c6082a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.921905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fee72f157c949b7808fdd7db5c6082a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.922590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fee72f157c949b7808fdd7db5c6082a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.933918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fee72f157c949b7808fdd7db5c6082a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.934622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fee72f157c949b7808fdd7db5c6082a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.951919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 888/1808] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:42 2022] DELETE /identity/v3/users/5fee72f157c949b7808fdd7db5c6082a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:42.959857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6906d7671db49eb9e5bf05ea70e2254'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.968127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6906d7671db49eb9e5bf05ea70e2254'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.980014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6906d7671db49eb9e5bf05ea70e2254'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.986673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6906d7671db49eb9e5bf05ea70e2254'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.987441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6906d7671db49eb9e5bf05ea70e2254'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:42.993700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 921/1809] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:42 2022] DELETE /identity/v3/users/e6906d7671db49eb9e5bf05ea70e2254 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:43.256803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.258323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:43.303585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.306012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:43.329446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe3c5-7eff-4e85-b8f7-97000bcfd429 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.376081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df694-3962-4187-9c08-5d09c3061541 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.382272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.383180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.383458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.383731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] PATH_INFO: `/v3/projects/a0479c9d2c52447b8409b09f5a932d1f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.384952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0479c9d2c52447b8409b09f5a932d1f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.386835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.391731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.392804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.393074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.393350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] PATH_INFO: `/v3/projects/85b8f8cada2d4a2584683436656d8c55` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.394541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b8f8cada2d4a2584683436656d8c55)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.396579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.447533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0479c9d2c52447b8409b09f5a932d1f', 'request_id': 'req-888c0df6-ea7a-455a-8ba0-8740006bdf5b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.447762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b8f8cada2d4a2584683436656d8c55', 'request_id': 'req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.454964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b8f8cada2d4a2584683436656d8c55', 'request_id': 'req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.455176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0479c9d2c52447b8409b09f5a932d1f', 'request_id': 'req-888c0df6-ea7a-455a-8ba0-8740006bdf5b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.464553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b8f8cada2d4a2584683436656d8c55', 'request_id': 'req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.468285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0479c9d2c52447b8409b09f5a932d1f', 'request_id': 'req-888c0df6-ea7a-455a-8ba0-8740006bdf5b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.479688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] The token cache is being invalidate because project 85b8f8cada2d4a2584683436656d8c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:43.480091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.480923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-316f5f5c-fd1c-4b4c-8bc9-fb60af75c830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.483588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 889/1810] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:43 2022] DELETE /identity/v3/projects/85b8f8cada2d4a2584683436656d8c55 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:43.488183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de85705-53a4-4f45-9e38-ad1f746b3309 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.488537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de85705-53a4-4f45-9e38-ad1f746b3309 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.488907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de85705-53a4-4f45-9e38-ad1f746b3309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.500107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] The token cache is being invalidate because project a0479c9d2c52447b8409b09f5a932d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:43.500653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.501564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-888c0df6-ea7a-455a-8ba0-8740006bdf5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:43.504143 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 922/1811] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:43 2022] DELETE /identity/v3/projects/a0479c9d2c52447b8409b09f5a932d1f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:43.511662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1de85705-53a4-4f45-9e38-ad1f746b3309 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:43.514380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1de85705-53a4-4f45-9e38-ad1f746b3309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:43.515280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5bae8-991f-43cd-87c8-73cdbb90af29 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.515575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5bae8-991f-43cd-87c8-73cdbb90af29 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.515852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5bae8-991f-43cd-87c8-73cdbb90af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.535919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e5a5bae8-991f-43cd-87c8-73cdbb90af29 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:43.537138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e5a5bae8-991f-43cd-87c8-73cdbb90af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:43.579381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 890/1812] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:43.587036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8da50-dcca-4d20-bed5-264a5467d914 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.587855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8da50-dcca-4d20-bed5-264a5467d914 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.587855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8da50-dcca-4d20-bed5-264a5467d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.601638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 923/1813] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:43.610656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897e980-67de-4ab1-a42f-4be38d522823 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.611010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-12b8da50-dcca-4d20-bed5-264a5467d914 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:43.611115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897e980-67de-4ab1-a42f-4be38d522823 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.611422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897e980-67de-4ab1-a42f-4be38d522823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.617394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-12b8da50-dcca-4d20-bed5-264a5467d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:43.634535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9897e980-67de-4ab1-a42f-4be38d522823 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:43.635784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9897e980-67de-4ab1-a42f-4be38d522823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:43.639449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 891/1814] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:43.643379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8da50-dcca-4d20-bed5-264a5467d914 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.647436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 924/1815] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:43.651538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897e980-67de-4ab1-a42f-4be38d522823 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.653253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8da50-dcca-4d20-bed5-264a5467d914 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.658207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.658887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.659165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.659595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.660435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:43.660857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.662364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.662621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897e980-67de-4ab1-a42f-4be38d522823 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.667455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.668290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.668677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.669051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.669997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:43.670375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.672045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.678238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 892/1816] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:43.679210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.684370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 925/1817] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:43.688439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.689107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126e9f8-9cdf-45e8-adea-ff7ffb032b18 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.693674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.694355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.694645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.694911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.695598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.697538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.697999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b81a3-55ac-49d3-9737-b00001a28b3b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.702785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.703426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.703712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.704056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.704770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.706643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.727954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 893/1818] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:43.729991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.735191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 926/1819] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:43.740690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.805468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4b0c5-b6d7-4891-9405-6d4548babf6e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.829765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8433d63-0427-4af2-b8eb-aa2c911222fa admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.835035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.835991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.836373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.836739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.837521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.839557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.864265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 927/1820] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:43.867703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.870797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.871472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.871736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.872241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.873145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.874981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.879073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f53c8-630f-4dde-b343-ee0b171d12bc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.884085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.884833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.885101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.885388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.887327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.889531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.899655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 894/1821] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:43.903287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 928/1822] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:43.903863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.907419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.915658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c0e7c-f9bd-4c55-a37e-210ce9c25383 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.917323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788acc10-ec2a-4ada-bda4-8bb55f77be1b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.920957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.921990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.922143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.922561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.923370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.925342 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.936584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 895/1823] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:43.940331 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.948502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.949202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.949540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.949801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.950632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.951405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b818d3-edee-4b49-b063-13628a4efc49 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.952564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.960895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.961672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.962022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.962364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.963160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.964960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.969036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 929/1824] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:43.973271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.980271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 896/1825] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:43.987289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca933d-9109-4784-9329-17504ad0510f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.990857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.991915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938e47-6d27-433e-bb41-85d2401a9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.992802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938e47-6d27-433e-bb41-85d2401a9334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.993082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938e47-6d27-433e-bb41-85d2401a9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.993351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938e47-6d27-433e-bb41-85d2401a9334 admin admin] PATH_INFO: `/v3/projects/a290c78963aa478587aa2dabb23ef83e/users/6123374bf3634593b549d6621b6a4d1c/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.000582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfdf00-681b-428c-a087-f2de413bf878 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.005280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72088-542c-472c-896f-533b51759f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.006168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72088-542c-472c-896f-533b51759f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.006445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72088-542c-472c-896f-533b51759f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.006711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72088-542c-472c-896f-533b51759f3d admin admin] PATH_INFO: `/v3/projects/188e61fe31434ba78fdc6bd9cbd98edb/users/61757474fdbf40439afcd423fe9052ff/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.010254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938e47-6d27-433e-bb41-85d2401a9334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a290c78963aa478587aa2dabb23ef83e, user_id=6123374bf3634593b549d6621b6a4d1c, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.013493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938e47-6d27-433e-bb41-85d2401a9334 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.023525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72088-542c-472c-896f-533b51759f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=188e61fe31434ba78fdc6bd9cbd98edb, user_id=61757474fdbf40439afcd423fe9052ff, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.027719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 930/1826] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:43 2022] PUT /identity/v3/projects/a290c78963aa478587aa2dabb23ef83e/users/6123374bf3634593b549d6621b6a4d1c/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:44.027912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72088-542c-472c-896f-533b51759f3d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.033002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.033380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.033564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.046484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 897/1827] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:43 2022] PUT /identity/v3/projects/188e61fe31434ba78fdc6bd9cbd98edb/users/61757474fdbf40439afcd423fe9052ff/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:44.055976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:44.057369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:44.057707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800b9d-dffc-4843-b72c-dfe9c7f73853 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.058071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800b9d-dffc-4843-b72c-dfe9c7f73853 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.058423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800b9d-dffc-4843-b72c-dfe9c7f73853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.088599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e4800b9d-dffc-4843-b72c-dfe9c7f73853 None None] MFA Rules not processed for user `61757474fdbf40439afcd423fe9052ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:44.089933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e4800b9d-dffc-4843-b72c-dfe9c7f73853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:44.119975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 931/1828] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:44.127686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.129268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:44.164481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 898/1829] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:44.168822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800b9d-dffc-4843-b72c-dfe9c7f73853 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.179812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800b9d-dffc-4843-b72c-dfe9c7f73853 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.185355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.185830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b588b9-33d7-444e-99dd-fd5c0187568e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.186091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.186436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.186714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.187424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.189377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.190173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.190827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.191108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.191381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.201714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.203290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.216352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 932/1830] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:44.218694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 899/1831] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:44 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:44.222749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.232872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621dd2a-811e-4f18-9cb2-e182ea68bbfe service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.292715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.293465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.293792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.294117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.295020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.297011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.319149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 933/1832] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:44 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:44.323554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.334974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef68a8-6800-4b84-9de8-e5e3d27cf106 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.340550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.341274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.341563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.342083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.342560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.344210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.356618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 900/1833] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:44.360869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.371812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9618af3-f08b-4dde-a193-59956ce56a26 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.378403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.379309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.379590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.380074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] PATH_INFO: `/v3/projects/f9cf07ca144c4916a45879a7831d7d9a/users/bff3478ef8964960a27cd2d327a58711/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.397688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cf07ca144c4916a45879a7831d7d9a, user_id=bff3478ef8964960a27cd2d327a58711, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.400537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.415224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 934/1834] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:44 2022] PUT /identity/v3/projects/f9cf07ca144c4916a45879a7831d7d9a/users/bff3478ef8964960a27cd2d327a58711/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:44.419643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.429968 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246a620-c757-49c9-997d-d8f8ec963b5d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.501712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02656647-592a-4c73-8347-6ddbb93d6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.502419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02656647-592a-4c73-8347-6ddbb93d6e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.502680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02656647-592a-4c73-8347-6ddbb93d6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.503217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02656647-592a-4c73-8347-6ddbb93d6e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.503990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02656647-592a-4c73-8347-6ddbb93d6e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.505819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02656647-592a-4c73-8347-6ddbb93d6e9c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.524701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 901/1835] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:44.528872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.538926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e78ad-94b4-41e6-9448-0e20f82eb754 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.543611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.544634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.544910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.545183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] PATH_INFO: `/v3/projects/f9cf07ca144c4916a45879a7831d7d9a/users/bff3478ef8964960a27cd2d327a58711/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.547852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cf07ca144c4916a45879a7831d7d9a, user_id=bff3478ef8964960a27cd2d327a58711, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.550550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.561075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 935/1836] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:44 2022] PUT /identity/v3/projects/f9cf07ca144c4916a45879a7831d7d9a/users/bff3478ef8964960a27cd2d327a58711/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:44.571398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b7575-162c-4d6d-b2c9-abd5aeaedd21 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.571774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b7575-162c-4d6d-b2c9-abd5aeaedd21 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.572111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b7575-162c-4d6d-b2c9-abd5aeaedd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.602853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f12b7575-162c-4d6d-b2c9-abd5aeaedd21 None None] MFA Rules not processed for user `bff3478ef8964960a27cd2d327a58711`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:44.604846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f12b7575-162c-4d6d-b2c9-abd5aeaedd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:44.690732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 902/1837] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:44.701557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.703297 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:44.763581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9382f-2ce1-4ef3-93d4-764b5bbebf4c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.767260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb724ea-62bc-43b9-8055-e6fbbdc592f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.767942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb724ea-62bc-43b9-8055-e6fbbdc592f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.768228 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb724ea-62bc-43b9-8055-e6fbbdc592f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.768504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb724ea-62bc-43b9-8055-e6fbbdc592f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:44.778506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb724ea-62bc-43b9-8055-e6fbbdc592f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:44.780422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb724ea-62bc-43b9-8055-e6fbbdc592f7 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:44.789928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 936/1838] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:44.925228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b7575-162c-4d6d-b2c9-abd5aeaedd21 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:44.991788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b7575-162c-4d6d-b2c9-abd5aeaedd21 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:44.997190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:44.998381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:44.998660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:44.998934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] PATH_INFO: `/v3/users/61757474fdbf40439afcd423fe9052ff` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.000233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61757474fdbf40439afcd423fe9052ff)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.002283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.051110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61757474fdbf40439afcd423fe9052ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.058251 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61757474fdbf40439afcd423fe9052ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.058982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61757474fdbf40439afcd423fe9052ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.071725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61757474fdbf40439afcd423fe9052ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.072629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61757474fdbf40439afcd423fe9052ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.088621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 903/1839] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:44 2022] DELETE /identity/v3/users/61757474fdbf40439afcd423fe9052ff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:45.093794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589993-f4d1-4a98-bccb-15297337248c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.094094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589993-f4d1-4a98-bccb-15297337248c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.094370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589993-f4d1-4a98-bccb-15297337248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.112714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bf589993-f4d1-4a98-bccb-15297337248c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:45.113959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bf589993-f4d1-4a98-bccb-15297337248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:45.195187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 937/1840] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:45.213174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.215897 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:45.258869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab234ad-7baf-4157-a285-b0fb7fce9071 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.259306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab234ad-7baf-4157-a285-b0fb7fce9071 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.259721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab234ad-7baf-4157-a285-b0fb7fce9071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.305470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bab234ad-7baf-4157-a285-b0fb7fce9071 None None] MFA Rules not processed for user `6123374bf3634593b549d6621b6a4d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:45.307250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bab234ad-7baf-4157-a285-b0fb7fce9071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:45.308515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916416a-e025-4778-bfa8-3f0a0f17f265 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.321233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.322960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.323407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.323848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.347319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.349343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.361857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 904/1841] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:45.416340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 938/1842] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:45.417749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.419260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:45.433531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224e47b-a963-44ff-b07e-a471ec8424ad service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.441354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.442227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.442602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.442998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.443917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.446946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.514900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 905/1843] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:45 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:45.515448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab234ad-7baf-4157-a285-b0fb7fce9071 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.532109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab234ad-7baf-4157-a285-b0fb7fce9071 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.630336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.631083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.631371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.631648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.632377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.634306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.656556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 939/1844] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:45 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:45.660863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.671234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dd4d5-5ebb-460d-b741-15e7636eb0b4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.676291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.677045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.677441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.677718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.678463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.680322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.693616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 906/1845] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:45.698602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.707049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.709226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:45.710509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca536410-3e30-48ff-a370-d99be1bf92d8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.716205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.717352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.717642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.717928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] PATH_INFO: `/v3/projects/4ea6ef0013b94746b3bf268a8ad1d469/users/92af66ab064f46689c5e67f09e4bf8d9/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.726350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa93c63-cbe7-4e20-a3ee-e3a452a105ab admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.736257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.736911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea6ef0013b94746b3bf268a8ad1d469, user_id=92af66ab064f46689c5e67f09e4bf8d9, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.737451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.737751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.738169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] PATH_INFO: `/v3/projects/188e61fe31434ba78fdc6bd9cbd98edb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.739612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188e61fe31434ba78fdc6bd9cbd98edb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.739721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.741851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.753496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 940/1846] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:45 2022] PUT /identity/v3/projects/4ea6ef0013b94746b3bf268a8ad1d469/users/92af66ab064f46689c5e67f09e4bf8d9/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:45.757414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.793786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188e61fe31434ba78fdc6bd9cbd98edb', 'request_id': 'req-5cd23bd8-cd18-4634-86e7-a7443f54f493'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.800158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188e61fe31434ba78fdc6bd9cbd98edb', 'request_id': 'req-5cd23bd8-cd18-4634-86e7-a7443f54f493'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.809810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188e61fe31434ba78fdc6bd9cbd98edb', 'request_id': 'req-5cd23bd8-cd18-4634-86e7-a7443f54f493'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.818366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c7d8b-4311-400b-a205-18f1fce78372 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.820426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] The token cache is being invalidate because project 188e61fe31434ba78fdc6bd9cbd98edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:45.820715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.821378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.822995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 907/1847] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:45 2022] DELETE /identity/v3/projects/188e61fe31434ba78fdc6bd9cbd98edb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:45.828036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.829375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:45.874294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.875012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.875291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.875573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.876347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.877969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.887641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 941/1848] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:45.891851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:45.893564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:45.895151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23bd8-cd18-4634-86e7-a7443f54f493 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.900127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.901629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.901931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.902218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] PATH_INFO: `/v3/users/bff3478ef8964960a27cd2d327a58711` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.903451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff3478ef8964960a27cd2d327a58711)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.905484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.905705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420547-2f43-46ff-b25d-848633b4c45f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:45.910365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:45.911255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:45.911554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:45.911814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] PATH_INFO: `/v3/projects/4ea6ef0013b94746b3bf268a8ad1d469/users/92af66ab064f46689c5e67f09e4bf8d9/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:45.913788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea6ef0013b94746b3bf268a8ad1d469, user_id=92af66ab064f46689c5e67f09e4bf8d9, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:45.916491 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:45.927998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 942/1849] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:45 2022] PUT /identity/v3/projects/4ea6ef0013b94746b3bf268a8ad1d469/users/92af66ab064f46689c5e67f09e4bf8d9/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:45.960264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff3478ef8964960a27cd2d327a58711'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.967129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff3478ef8964960a27cd2d327a58711'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.967795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff3478ef8964960a27cd2d327a58711'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.979535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff3478ef8964960a27cd2d327a58711'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.980222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e8f2c7c3-2bdc-4a51-8bce-230ad04c8f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff3478ef8964960a27cd2d327a58711'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:45.995456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 908/1850] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:45 2022] DELETE /identity/v3/users/bff3478ef8964960a27cd2d327a58711 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:46.548464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:46.550979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:46.660693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd0bd-6b2e-4883-8df1-ecaf04820cbc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:46.750407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:46.753096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:46.754290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:46.754671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] PATH_INFO: `/v3/projects/f9cf07ca144c4916a45879a7831d7d9a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:46.783899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9cf07ca144c4916a45879a7831d7d9a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:46.783899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:46.792613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:46.793465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:46.793890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:46.832935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9cf07ca144c4916a45879a7831d7d9a', 'request_id': 'req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:46.839606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9cf07ca144c4916a45879a7831d7d9a', 'request_id': 'req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:46.849780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9cf07ca144c4916a45879a7831d7d9a', 'request_id': 'req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:46.853646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] MFA Rules not processed for user `92af66ab064f46689c5e67f09e4bf8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:46.855904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:46.861694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] The token cache is being invalidate because project f9cf07ca144c4916a45879a7831d7d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:46.861999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:46.862649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-178b061e-d3a4-4ee8-a4c2-b762f4b25cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:46.868221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 943/1851] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:46 2022] DELETE /identity/v3/projects/f9cf07ca144c4916a45879a7831d7d9a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:46.870741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e596-6b8e-464d-9e91-203d6e67450a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:46.871071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e596-6b8e-464d-9e91-203d6e67450a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:46.871316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e596-6b8e-464d-9e91-203d6e67450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:46.905034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bfb7e596-6b8e-464d-9e91-203d6e67450a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:46.906544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bfb7e596-6b8e-464d-9e91-203d6e67450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:46.964617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 909/1852] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:46.977240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:46.978868 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:46.996822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 944/1853] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:47.005105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f875d-0997-408e-9aa8-37b6d87ba565 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.005462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f875d-0997-408e-9aa8-37b6d87ba565 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.005803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f875d-0997-408e-9aa8-37b6d87ba565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.026041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-783f875d-0997-408e-9aa8-37b6d87ba565 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:47.027347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-783f875d-0997-408e-9aa8-37b6d87ba565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:47.036843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 945/1854] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:47.041587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f875d-0997-408e-9aa8-37b6d87ba565 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.052737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f875d-0997-408e-9aa8-37b6d87ba565 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.058971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.059768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.060194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.060561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.061388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:47.061512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873a3c7-91bb-4d8f-9dab-2b1b69b31f07 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.061710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.063337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.065523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.066253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.066466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.066763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.068575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:47.075504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 946/1855] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:47.080912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.093094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9952a-faca-4121-ad6a-76f794cf08b7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.100156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.101121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.101419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.101694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.102522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.104671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.140442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 947/1856] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:47 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:47.144398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.145313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.146934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.158318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 910/1857] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:47.213450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70bafb-95ee-46e1-a0ee-62e1bb532be0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.218960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.219745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.220666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.221044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.221978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.224975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.248010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 948/1858] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:47 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:47.252169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.263456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586786ea-3ff5-4af9-928a-ebeaa050e61d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.268162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.268869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.269149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.269427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.270145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.271771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.284526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 911/1859] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:47.285737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.297277 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169dd07-91a1-41e8-8285-d3465cbc682b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.302397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d94b2-a321-4fdd-849e-cb201051a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.303096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d94b2-a321-4fdd-849e-cb201051a433 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.303420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d94b2-a321-4fdd-849e-cb201051a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.303667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d94b2-a321-4fdd-849e-cb201051a433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.304538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d94b2-a321-4fdd-849e-cb201051a433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.306146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d94b2-a321-4fdd-849e-cb201051a433 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.318007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 949/1860] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:47.322954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.333405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caddd2-6978-475a-8975-ea359b1759bc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.338642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.339660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.340053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.340396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] PATH_INFO: `/v3/projects/5c34aeb75ae64d59a63f2310e773395f/users/3744995eec654f219cd2bb4fb31e58a6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.355722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c34aeb75ae64d59a63f2310e773395f, user_id=3744995eec654f219cd2bb4fb31e58a6, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.358449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.372547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 912/1861] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:47 2022] PUT /identity/v3/projects/5c34aeb75ae64d59a63f2310e773395f/users/3744995eec654f219cd2bb4fb31e58a6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:47.384806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62607280-0dcd-4d11-b516-2eb9ece0fa53 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.385092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62607280-0dcd-4d11-b516-2eb9ece0fa53 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.385377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62607280-0dcd-4d11-b516-2eb9ece0fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.418993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-62607280-0dcd-4d11-b516-2eb9ece0fa53 None None] MFA Rules not processed for user `3744995eec654f219cd2bb4fb31e58a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:47.420460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-62607280-0dcd-4d11-b516-2eb9ece0fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:47.494386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 950/1862] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:47.499606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.567354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7df0a-6b22-4577-94f6-1124834620b7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.572383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.573121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.573400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.573670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.574360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.576545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.603902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 913/1863] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:47 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:47.607975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62607280-0dcd-4d11-b516-2eb9ece0fa53 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.618599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62607280-0dcd-4d11-b516-2eb9ece0fa53 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.676977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.677672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.677953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.678211 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.678933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.680914 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.703537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 951/1864] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:47 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:47.707646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.721506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31185e-01de-4057-b09b-bb070d323623 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.727203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.728188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.728527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.728860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.729760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.731659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.747436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 914/1865] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:47.751600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.770827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76a7c-6676-4b66-8af1-656f0500b28a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.770827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca12f3-b009-4623-a669-4e409d6e9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.770827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca12f3-b009-4623-a669-4e409d6e9ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.770827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca12f3-b009-4623-a669-4e409d6e9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.771525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca12f3-b009-4623-a669-4e409d6e9ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.772125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca12f3-b009-4623-a669-4e409d6e9ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.773685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca12f3-b009-4623-a669-4e409d6e9ffc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.795528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 952/1866] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:47.798660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:47.809346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daa54d-43e7-4458-b292-27649fdb7260 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:47.814835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:47.815725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.816176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.816464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] PATH_INFO: `/v3/projects/4cb11b0738894ed2a744a83d38d8f0f0/users/fb2ac09c64cc499798ff45aeeb67c3b2/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.836129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb11b0738894ed2a744a83d38d8f0f0, user_id=fb2ac09c64cc499798ff45aeeb67c3b2, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:47.839549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:47.855690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 915/1867] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:47 2022] PUT /identity/v3/projects/4cb11b0738894ed2a744a83d38d8f0f0/users/fb2ac09c64cc499798ff45aeeb67c3b2/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:47.869313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e66e1e-70d5-40bd-8932-2a0fac67ad92 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:47.869711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e66e1e-70d5-40bd-8932-2a0fac67ad92 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:47.870146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e66e1e-70d5-40bd-8932-2a0fac67ad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:47.913075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-23e66e1e-70d5-40bd-8932-2a0fac67ad92 None None] MFA Rules not processed for user `fb2ac09c64cc499798ff45aeeb67c3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:47.914537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-23e66e1e-70d5-40bd-8932-2a0fac67ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:48.004707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 953/1868] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:48.009389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.098792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6e1f7-d8a5-4763-a5cf-88cf03230544 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.103858 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.104734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.105110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.105484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.106282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.108673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.135571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 916/1869] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:48 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:48.139761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e66e1e-70d5-40bd-8932-2a0fac67ad92 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.151615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e66e1e-70d5-40bd-8932-2a0fac67ad92 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.210072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.210925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.211216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.211528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.212255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.214236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.235341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 954/1870] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:48 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:48.240720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.251807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b3c1c-f299-47dc-9d74-1faf9b50302c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.256644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.257252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.257528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.257798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.258520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.260160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.271398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 917/1871] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:48.275642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.285805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986821-9a31-4ee6-8d13-3fa96464b4d0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.290853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.291745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.292048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.292322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] PATH_INFO: `/v3/projects/65d1f2b381c3462cbea6563eadb1ceef/users/aaf8281ed68b494f86f1b6995b2517ce/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.307632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d1f2b381c3462cbea6563eadb1ceef, user_id=aaf8281ed68b494f86f1b6995b2517ce, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.310619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.325336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 955/1872] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:48 2022] PUT /identity/v3/projects/65d1f2b381c3462cbea6563eadb1ceef/users/aaf8281ed68b494f86f1b6995b2517ce/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:48.329494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.341426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46aa27-a749-4878-934f-914983066d8b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.403214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74198b67-c7e1-454f-9f24-edc22f1b468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.403992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198b67-c7e1-454f-9f24-edc22f1b468d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.404259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198b67-c7e1-454f-9f24-edc22f1b468d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.404527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198b67-c7e1-454f-9f24-edc22f1b468d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.405279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74198b67-c7e1-454f-9f24-edc22f1b468d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.406900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74198b67-c7e1-454f-9f24-edc22f1b468d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.416957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 918/1873] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:48.421135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.431358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513bd2-5ba1-4594-a9a5-f34d4bc01a16 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.437661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.438679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.439182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.439578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] PATH_INFO: `/v3/projects/65d1f2b381c3462cbea6563eadb1ceef/users/aaf8281ed68b494f86f1b6995b2517ce/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.442841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d1f2b381c3462cbea6563eadb1ceef, user_id=aaf8281ed68b494f86f1b6995b2517ce, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.447343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.460035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 956/1874] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:48 2022] PUT /identity/v3/projects/65d1f2b381c3462cbea6563eadb1ceef/users/aaf8281ed68b494f86f1b6995b2517ce/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:48.472134 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.472567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.473180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.503355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] MFA Rules not processed for user `aaf8281ed68b494f86f1b6995b2517ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:48.504736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:48.535483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.610642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 919/1875] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:48.611397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70950233-659a-4e6b-8a00-9a8e2f7c20ec admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.615128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.615779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.616173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.616445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.622116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.623679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:48.635130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63dfad-a4cb-469d-8222-a67bb5f3745e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.638746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.639406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.639665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.639965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.649007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.650565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.660551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 920/1876] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:48.678009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.679464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.689603 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 957/1877] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:48.702186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:48.710884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97298-a68c-4821-8405-201f65ad80b5 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:48.714814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15e342-c47d-4b32-9170-f85b465b73e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:48.715482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e342-c47d-4b32-9170-f85b465b73e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:48.715763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e342-c47d-4b32-9170-f85b465b73e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:48.716119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e342-c47d-4b32-9170-f85b465b73e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:48.772495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15e342-c47d-4b32-9170-f85b465b73e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:48.774080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15e342-c47d-4b32-9170-f85b465b73e8 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:48.783810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 921/1878] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:50.690042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:50.691633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:50.774703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301393-ba48-4aed-a4d1-f149a4732668 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:50.781259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:50.782208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:50.782488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:50.782764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] PATH_INFO: `/v3/users/afd0f67d035b4eb69ddfb62afac7f9ad` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:50.784158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd0f67d035b4eb69ddfb62afac7f9ad)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:50.786159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:50.840517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd0f67d035b4eb69ddfb62afac7f9ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:50.851707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd0f67d035b4eb69ddfb62afac7f9ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:50.866712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd0f67d035b4eb69ddfb62afac7f9ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:50.874608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd0f67d035b4eb69ddfb62afac7f9ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:50.875466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd0f67d035b4eb69ddfb62afac7f9ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:50.882356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 958/1879] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:50 2022] DELETE /identity/v3/users/afd0f67d035b4eb69ddfb62afac7f9ad => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:50.887215 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:50.887758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:50.887758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:50.907608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:50.908980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:50.973949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 922/1880] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:50.984267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:50.985861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:51.048110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b3e1-c3b3-4576-9f14-b7973b639c1c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:51.051699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:51.052380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:51.052667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:51.052941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:51.062501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:51.064104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:51.073862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 959/1881] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:54:51.477481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:51.478935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:51.494527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e37e02-1513-4a38-87b4-7232c4ec725a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:51.501653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:51.504869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:51.505846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:51.505846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] PATH_INFO: `/v3/projects/7b420b210bbd49c48388d6fc5d76e062` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:51.507085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b420b210bbd49c48388d6fc5d76e062)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:51.511909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:51.602866 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b420b210bbd49c48388d6fc5d76e062', 'request_id': 'req-9b185d2b-0474-405a-ad18-fa1abf8d52ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.625502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b420b210bbd49c48388d6fc5d76e062', 'request_id': 'req-9b185d2b-0474-405a-ad18-fa1abf8d52ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.634794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b420b210bbd49c48388d6fc5d76e062', 'request_id': 'req-9b185d2b-0474-405a-ad18-fa1abf8d52ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.648259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] The token cache is being invalidate because project 7b420b210bbd49c48388d6fc5d76e062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:51.648837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.649872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.651612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 923/1882] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:51 2022] DELETE /identity/v3/projects/7b420b210bbd49c48388d6fc5d76e062 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:51.656281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:51.667940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede5567-f337-4e04-b09f-6e71bfecd501 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:51.739419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:51.740477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:51.740825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:51.741170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] PATH_INFO: `/v3/users/edc0af999c784959b19a0726fa694c29` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:51.743238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc0af999c784959b19a0726fa694c29)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:51.744577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:51.793097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc0af999c784959b19a0726fa694c29'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.804569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc0af999c784959b19a0726fa694c29'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.833322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc0af999c784959b19a0726fa694c29'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.840380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc0af999c784959b19a0726fa694c29'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.841205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc0af999c784959b19a0726fa694c29'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:51.847785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 960/1883] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:51 2022] DELETE /identity/v3/users/edc0af999c784959b19a0726fa694c29 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:52.189482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.190917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:52.204982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b185d2b-0474-405a-ad18-fa1abf8d52ae admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.221300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.223313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:52.266743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.267623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.267934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.268214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] PATH_INFO: `/v3/users/3744995eec654f219cd2bb4fb31e58a6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.269391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3744995eec654f219cd2bb4fb31e58a6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.271333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.292114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068a0d8-b5bf-4fb9-b64d-b4732dc7b083 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.297267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.298321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.298572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.298897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] PATH_INFO: `/v3/projects/b06b61f02a7f49be95573cf97056e0e2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.300367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06b61f02a7f49be95573cf97056e0e2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.302406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.324457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3744995eec654f219cd2bb4fb31e58a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.331927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3744995eec654f219cd2bb4fb31e58a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.332934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3744995eec654f219cd2bb4fb31e58a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.345926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3744995eec654f219cd2bb4fb31e58a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.346642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05bd2656-10fe-496e-87c7-6b37a9bb395f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3744995eec654f219cd2bb4fb31e58a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.357168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06b61f02a7f49be95573cf97056e0e2', 'request_id': 'req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.361479 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 924/1884] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:52 2022] DELETE /identity/v3/users/3744995eec654f219cd2bb4fb31e58a6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:52.365931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06b61f02a7f49be95573cf97056e0e2', 'request_id': 'req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.366122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.366499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.366875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.375961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06b61f02a7f49be95573cf97056e0e2', 'request_id': 'req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.385508 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:52.386838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:52.388335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] The token cache is being invalidate because project b06b61f02a7f49be95573cf97056e0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:52.388628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.390517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6daedf23-71c0-4ab2-9a7b-eefe0030a1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:52.391513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 961/1885] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:52 2022] DELETE /identity/v3/projects/b06b61f02a7f49be95573cf97056e0e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:52.396745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc44da-04ec-4a3d-873f-98621dde1c94 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.396745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc44da-04ec-4a3d-873f-98621dde1c94 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.397119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc44da-04ec-4a3d-873f-98621dde1c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.417292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c1cc44da-04ec-4a3d-873f-98621dde1c94 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:52.418499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c1cc44da-04ec-4a3d-873f-98621dde1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:52.458694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 925/1886] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:52.466157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.468265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:52.482098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 962/1887] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:52.490303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de25fb-b5d6-492e-bd14-50ae71e2fb53 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.490592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de25fb-b5d6-492e-bd14-50ae71e2fb53 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.490869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de25fb-b5d6-492e-bd14-50ae71e2fb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.509740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d4de25fb-b5d6-492e-bd14-50ae71e2fb53 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:52.510979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d4de25fb-b5d6-492e-bd14-50ae71e2fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:52.520087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 963/1888] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:52.524463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de25fb-b5d6-492e-bd14-50ae71e2fb53 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.534532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de25fb-b5d6-492e-bd14-50ae71e2fb53 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.539244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.539932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.540220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.540482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.541349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:52.541666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.543244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.547555 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bd4fb-d464-4ec8-8ae8-197f341b02ba None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.551457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.552312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.552659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.552999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.559322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 964/1889] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:52.560791 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.563398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.564908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.571802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c7045-abfa-4964-8fcb-c7b3c3ee8415 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.578408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.579428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.580125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.580125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.580931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.582950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.604976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 926/1890] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:52.650852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 965/1891] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:52 2022] POST /identity/v3/projects => generated 407 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:52.655526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.669914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82ead-dd23-4a9b-b38d-5a8323a114d3 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.769057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.769772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.770059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.770339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.771412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.773833 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.802603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 927/1892] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:52 2022] POST /identity/v3/users => generated 304 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:52.806802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.825259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ded04-df50-4ca4-a1a1-0149f83ab431 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.842535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.843179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.843460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.843738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.844548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.846193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.858065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 966/1893] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:52.862380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.874243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0615c7e-85c0-4686-9d43-b8f8634c39ac admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.881487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.882059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.882340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.882612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.883367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.885080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:52.897764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 928/1894] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:52.902173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:52.920183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db0b9b-95a0-49b4-b5a1-2a567b9a0f96 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:52.930422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9b600-f970-4adb-b716-ff48074324aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:52.932315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9b600-f970-4adb-b716-ff48074324aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:52.932602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9b600-f970-4adb-b716-ff48074324aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:52.936912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9b600-f970-4adb-b716-ff48074324aa admin admin] PATH_INFO: `/v3/projects/1c0347615d084040b02015be4fd4b692/users/e2c1ee271ba04a4fa193699551f5e7cd/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:52.977745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9b600-f970-4adb-b716-ff48074324aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0347615d084040b02015be4fd4b692, user_id=e2c1ee271ba04a4fa193699551f5e7cd, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:52.980451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9b600-f970-4adb-b716-ff48074324aa admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.008476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.010372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:53.027416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 967/1895] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:52 2022] PUT /identity/v3/projects/1c0347615d084040b02015be4fd4b692/users/e2c1ee271ba04a4fa193699551f5e7cd/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:53.033373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fc1b1-f756-47d3-9088-39f50f4352d5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.048907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826271-5cf3-415a-bf19-66b6a020e16a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.050252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826271-5cf3-415a-bf19-66b6a020e16a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.051169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a826271-5cf3-415a-bf19-66b6a020e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.118216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2a826271-5cf3-415a-bf19-66b6a020e16a None None] MFA Rules not processed for user `e2c1ee271ba04a4fa193699551f5e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:53.122015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2a826271-5cf3-415a-bf19-66b6a020e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:53.143823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.146267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.146659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.147070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] PATH_INFO: `/v3/projects/5c34aeb75ae64d59a63f2310e773395f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.148816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c34aeb75ae64d59a63f2310e773395f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.151119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.241205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c34aeb75ae64d59a63f2310e773395f', 'request_id': 'req-02afcfbc-0c28-4773-9ab0-f670c613b9ef'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.251473 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c34aeb75ae64d59a63f2310e773395f', 'request_id': 'req-02afcfbc-0c28-4773-9ab0-f670c613b9ef'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.261960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c34aeb75ae64d59a63f2310e773395f', 'request_id': 'req-02afcfbc-0c28-4773-9ab0-f670c613b9ef'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.274836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 968/1896] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:54:53.279784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826271-5cf3-415a-bf19-66b6a020e16a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.286957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] The token cache is being invalidate because project 5c34aeb75ae64d59a63f2310e773395f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:53.286957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.288093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.291671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a826271-5cf3-415a-bf19-66b6a020e16a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.292052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 929/1897] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:53 2022] DELETE /identity/v3/projects/5c34aeb75ae64d59a63f2310e773395f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:53.296395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.298628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:53.374991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.376284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.376811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.377279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.378364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.381010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.389787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afcfbc-0c28-4773-9ab0-f670c613b9ef admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.395534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.396646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.397136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.397615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] PATH_INFO: `/v3/users/fb2ac09c64cc499798ff45aeeb67c3b2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.399457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2ac09c64cc499798ff45aeeb67c3b2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.402174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.419851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 969/1898] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:53 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:53.424180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.427806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:53.500534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2ac09c64cc499798ff45aeeb67c3b2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.522249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2ac09c64cc499798ff45aeeb67c3b2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.524170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2ac09c64cc499798ff45aeeb67c3b2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.549302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2ac09c64cc499798ff45aeeb67c3b2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.550079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2ac09c64cc499798ff45aeeb67c3b2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:53.568723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 930/1899] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:53 2022] DELETE /identity/v3/users/fb2ac09c64cc499798ff45aeeb67c3b2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:53.589595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f50239-fd9f-4ed9-9130-be0ccb1a0a62 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.672971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.673711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.673989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.674263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.674963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.677192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.702143 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 970/1900] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:53 2022] POST /identity/v3/users => generated 311 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:54:53.707166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.710623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:53.726957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627481c-78f8-4ad6-8b46-5865ed210fe2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.733482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.734311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.734644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.734984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.735797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.737530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.752998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 931/1901] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:53.754147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.766644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae37a6-283b-4d84-a19c-cab087306656 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.772510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.774126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.774418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.774705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] PATH_INFO: `/v3/projects/2ff1dc400a364536b5519ba6964bff1d/users/d1d415111ddf45cbb86c2078ed0880a6/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.797361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff1dc400a364536b5519ba6964bff1d, user_id=d1d415111ddf45cbb86c2078ed0880a6, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.800365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.820780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 971/1902] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:53 2022] PUT /identity/v3/projects/2ff1dc400a364536b5519ba6964bff1d/users/d1d415111ddf45cbb86c2078ed0880a6/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:53.822597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.851050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7e2d-7731-4def-8cb1-71b4a16e2659 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.915751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ba6c9-e078-42d8-abcc-c5047028b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.916553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ba6c9-e078-42d8-abcc-c5047028b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.916835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ba6c9-e078-42d8-abcc-c5047028b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.917108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ba6c9-e078-42d8-abcc-c5047028b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.918744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ba6c9-e078-42d8-abcc-c5047028b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.926179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ba6c9-e078-42d8-abcc-c5047028b9eb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.948408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:53.957714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 932/1903] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:53.968847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48d39-340f-4b25-9202-d424ee302b0a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:53.975119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:53.976503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:53.976891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:53.977289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] PATH_INFO: `/v3/projects/2ff1dc400a364536b5519ba6964bff1d/users/d1d415111ddf45cbb86c2078ed0880a6/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:53.980553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff1dc400a364536b5519ba6964bff1d, user_id=d1d415111ddf45cbb86c2078ed0880a6, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:53.985415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:53.999991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 972/1904] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:53 2022] PUT /identity/v3/projects/2ff1dc400a364536b5519ba6964bff1d/users/d1d415111ddf45cbb86c2078ed0880a6/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:54.011317 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cee8-941d-4a35-8e1f-3c3e4f078b12 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:54.011936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cee8-941d-4a35-8e1f-3c3e4f078b12 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:54.012314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cee8-941d-4a35-8e1f-3c3e4f078b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:54.043518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e410cee8-941d-4a35-8e1f-3c3e4f078b12 None None] MFA Rules not processed for user `d1d415111ddf45cbb86c2078ed0880a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:54.044976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e410cee8-941d-4a35-8e1f-3c3e4f078b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:54.122412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 933/1905] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:54.132977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:54.137205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:54.255459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4996c7-37aa-4e04-bba2-39f500cb0dd7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:54.261607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:54.262556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:54.263026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:54.263448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:54.288161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:54.288161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:54.308496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 973/1906] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:54.610845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cee8-941d-4a35-8e1f-3c3e4f078b12 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:54.628842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cee8-941d-4a35-8e1f-3c3e4f078b12 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:54.637576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:54.638632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:54.639612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:54.640778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:54.643543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:54.744922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:54.746708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:54.757443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 934/1907] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:54.982204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:54.984563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:55.090620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf2df-115e-4d68-b070-c59839d77f7c service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:55.102550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:55.104928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:55.105329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:55.106249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] PATH_INFO: `/v3/projects/4cb11b0738894ed2a744a83d38d8f0f0` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:55.107712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb11b0738894ed2a744a83d38d8f0f0)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:55.110186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:55.174721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb11b0738894ed2a744a83d38d8f0f0', 'request_id': 'req-30dba9c5-0d85-442d-bfa2-062ee1879451'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.181954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb11b0738894ed2a744a83d38d8f0f0', 'request_id': 'req-30dba9c5-0d85-442d-bfa2-062ee1879451'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.191212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb11b0738894ed2a744a83d38d8f0f0', 'request_id': 'req-30dba9c5-0d85-442d-bfa2-062ee1879451'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.207337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] The token cache is being invalidate because project 4cb11b0738894ed2a744a83d38d8f0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:55.208138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.209460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.212810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 974/1908] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:54 2022] DELETE /identity/v3/projects/4cb11b0738894ed2a744a83d38d8f0f0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:55.216593 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:55.239855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690be30-66e6-4608-91ec-d7e70093d0bc service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:55.310863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:55.312011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:55.312296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:55.312571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] PATH_INFO: `/v3/users/aaf8281ed68b494f86f1b6995b2517ce` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:55.313845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf8281ed68b494f86f1b6995b2517ce)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:55.315796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:55.362699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf8281ed68b494f86f1b6995b2517ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.369908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf8281ed68b494f86f1b6995b2517ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.370691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf8281ed68b494f86f1b6995b2517ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.382620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf8281ed68b494f86f1b6995b2517ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.383322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b8f8590a-d79b-49fa-97e8-ae81e29a84ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf8281ed68b494f86f1b6995b2517ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.398006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 935/1909] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:55 2022] DELETE /identity/v3/users/aaf8281ed68b494f86f1b6995b2517ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:55.684102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:55.685584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:55.709195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba9c5-0d85-442d-bfa2-062ee1879451 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:55.773498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:55.774736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:55.774736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:55.774923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] PATH_INFO: `/v3/projects/65d1f2b381c3462cbea6563eadb1ceef` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:55.776131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d1f2b381c3462cbea6563eadb1ceef)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:55.778077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:55.835676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d1f2b381c3462cbea6563eadb1ceef', 'request_id': 'req-addd49cd-342f-4f35-b26f-d85abad7d98f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.841923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d1f2b381c3462cbea6563eadb1ceef', 'request_id': 'req-addd49cd-342f-4f35-b26f-d85abad7d98f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.851941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d1f2b381c3462cbea6563eadb1ceef', 'request_id': 'req-addd49cd-342f-4f35-b26f-d85abad7d98f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.862018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] The token cache is being invalidate because project 65d1f2b381c3462cbea6563eadb1ceef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:55.862377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.863074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-addd49cd-342f-4f35-b26f-d85abad7d98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:55.864726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 975/1910] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:55 2022] DELETE /identity/v3/projects/65d1f2b381c3462cbea6563eadb1ceef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:55.870664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611228c-2ed0-4272-ab1e-d0504cf1b798 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:55.871159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611228c-2ed0-4272-ab1e-d0504cf1b798 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:55.871245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611228c-2ed0-4272-ab1e-d0504cf1b798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:55.889871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b611228c-2ed0-4272-ab1e-d0504cf1b798 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:55.891154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b611228c-2ed0-4272-ab1e-d0504cf1b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:55.978361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 936/1911] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:55.987054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c32f-2b0a-421d-93ee-3be9d4834df6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:55.987514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c32f-2b0a-421d-93ee-3be9d4834df6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:55.987930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c32f-2b0a-421d-93ee-3be9d4834df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.011793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7a37c32f-2b0a-421d-93ee-3be9d4834df6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:56.013931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7a37c32f-2b0a-421d-93ee-3be9d4834df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:56.025144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 976/1912] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:56.029332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611228c-2ed0-4272-ab1e-d0504cf1b798 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.044894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611228c-2ed0-4272-ab1e-d0504cf1b798 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.050082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.051078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.051364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.051638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.052429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:56.052737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.054364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.067598 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 937/1913] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:56.073906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c32f-2b0a-421d-93ee-3be9d4834df6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.084186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c32f-2b0a-421d-93ee-3be9d4834df6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.089478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.090150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.090489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.090766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.091496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.093459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.125652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 977/1914] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:56 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:56.127165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.138313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54770ce-90ad-4f8d-aedb-2272d2d0e076 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.204910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.205602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.205887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.206169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.206891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.208933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.233832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 938/1915] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:56 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:56.235024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.245532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca70f8d-703f-406a-98b2-9b0680c74641 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.250748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.251793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.252312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.252654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.253526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.255343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.267005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 978/1916] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:56.271244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.281321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be2cf-4183-46b9-a9fb-f83848e13bcc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.286219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcb437-c4e0-4c7d-87de-9c8c721909b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.286871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb437-c4e0-4c7d-87de-9c8c721909b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.287154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb437-c4e0-4c7d-87de-9c8c721909b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.287428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb437-c4e0-4c7d-87de-9c8c721909b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.288419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcb437-c4e0-4c7d-87de-9c8c721909b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.289918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcb437-c4e0-4c7d-87de-9c8c721909b8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.300677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 939/1917] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:56.304723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.315038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ea739-3fec-4961-86a0-efd06fbd6b17 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.320263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.321256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.321607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.321945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] PATH_INFO: `/v3/projects/697bde106383466bb91715cf370776e1/users/da1f62577429411abf4d751066e3282a/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.338038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] RBAC: Authorizing `identity:create_grant(project_id=697bde106383466bb91715cf370776e1, user_id=da1f62577429411abf4d751066e3282a, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.340845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.359960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 979/1918] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:56 2022] PUT /identity/v3/projects/697bde106383466bb91715cf370776e1/users/da1f62577429411abf4d751066e3282a/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:56.372058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15644bd-a207-48f4-b593-5b76235aeab9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.372357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15644bd-a207-48f4-b593-5b76235aeab9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.372770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15644bd-a207-48f4-b593-5b76235aeab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.403998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a15644bd-a207-48f4-b593-5b76235aeab9 None None] MFA Rules not processed for user `da1f62577429411abf4d751066e3282a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:56.405077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a15644bd-a207-48f4-b593-5b76235aeab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:56.487261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 940/1919] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:56.499706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.502725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:56.565699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d82ca-8f90-4f0f-9a81-2af1503b405d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.570261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9475a6-3153-41e1-a206-aac518f289c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.571023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9475a6-3153-41e1-a206-aac518f289c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.571598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9475a6-3153-41e1-a206-aac518f289c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.571924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9475a6-3153-41e1-a206-aac518f289c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.582773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9475a6-3153-41e1-a206-aac518f289c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.584274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9475a6-3153-41e1-a206-aac518f289c1 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.595175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 980/1920] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:56.615573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15644bd-a207-48f4-b593-5b76235aeab9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.677615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15644bd-a207-48f4-b593-5b76235aeab9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.682751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.683620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.683914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.684277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] PATH_INFO: `/v3/users/da1f62577429411abf4d751066e3282a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.685513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1f62577429411abf4d751066e3282a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.687499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.736670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1f62577429411abf4d751066e3282a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:56.743515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1f62577429411abf4d751066e3282a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:56.744206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1f62577429411abf4d751066e3282a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:56.757759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1f62577429411abf4d751066e3282a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:56.758469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1f62577429411abf4d751066e3282a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:56.773937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 941/1921] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:54:56 2022] DELETE /identity/v3/users/da1f62577429411abf4d751066e3282a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:56.778609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.778903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.779186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.797691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:56.798990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:56.876037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 981/1922] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:56.888032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:56.889972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:56.955153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76e09a-97a3-4513-ba9f-5c6769d92205 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:56.959236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e33a0-76c4-4954-b084-a1d05a602af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:56.960053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e33a0-76c4-4954-b084-a1d05a602af8 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:56.960438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e33a0-76c4-4954-b084-a1d05a602af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:56.960807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e33a0-76c4-4954-b084-a1d05a602af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:56.971058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e33a0-76c4-4954-b084-a1d05a602af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:56.972828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e33a0-76c4-4954-b084-a1d05a602af8 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:56.985783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 942/1923] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:54:57.316027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:57.317438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:57.340573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf5d89-3b00-4378-96e8-0f2a0dcafa33 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:57.348345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:57.350308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.350679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.351508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] PATH_INFO: `/v3/projects/697bde106383466bb91715cf370776e1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.352948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=697bde106383466bb91715cf370776e1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:57.357742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:57.414700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697bde106383466bb91715cf370776e1', 'request_id': 'req-b5cf84fb-973e-4d0a-a557-0612c47450bd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:57.421096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697bde106383466bb91715cf370776e1', 'request_id': 'req-b5cf84fb-973e-4d0a-a557-0612c47450bd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:57.431809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697bde106383466bb91715cf370776e1', 'request_id': 'req-b5cf84fb-973e-4d0a-a557-0612c47450bd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:57.442548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] The token cache is being invalidate because project 697bde106383466bb91715cf370776e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:54:57.442839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:57.443511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b5cf84fb-973e-4d0a-a557-0612c47450bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:54:57.445179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 982/1924] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:54:57 2022] DELETE /identity/v3/projects/697bde106383466bb91715cf370776e1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:57.450148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1de746-fe6c-455d-a900-3aef549acde3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.450442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1de746-fe6c-455d-a900-3aef549acde3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.450724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1de746-fe6c-455d-a900-3aef549acde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.469201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-eb1de746-fe6c-455d-a900-3aef549acde3 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:57.471669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eb1de746-fe6c-455d-a900-3aef549acde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:57.542613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 943/1925] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:57.551361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a53b4-4e7c-4408-92f7-befd414160ee None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.551652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a53b4-4e7c-4408-92f7-befd414160ee None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.551960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a53b4-4e7c-4408-92f7-befd414160ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.570049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a53a53b4-4e7c-4408-92f7-befd414160ee None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:57.571261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a53a53b4-4e7c-4408-92f7-befd414160ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:57.580018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 983/1926] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:57.584379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1de746-fe6c-455d-a900-3aef549acde3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:57.594072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1de746-fe6c-455d-a900-3aef549acde3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:57.599436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:57.600137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.600427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.600699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.601427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:57.601736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:57.603341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:57.615491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 944/1927] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:57.619589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a53b4-4e7c-4408-92f7-befd414160ee None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:57.629266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a53b4-4e7c-4408-92f7-befd414160ee None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:57.634264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:57.635121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.635406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.635673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.636410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:57.638333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:57.666283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 984/1928] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:57 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:57.670527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:57.681340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fd37-6e65-4fd1-b4c6-01e51ea034b9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:57.740806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:57.741458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.741738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.742012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.742695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:57.744659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:57.768537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 945/1929] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:57 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:57.772824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:57.783398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6fa17-cca5-4603-b066-d2e94898ab0d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:57.788225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:57.788884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.789162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.790208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.791452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:57.794304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:57.805808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 985/1930] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:57.811800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:57.827591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255343-8c0c-4c45-b805-071f3ea729f7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:57.833604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2361-8851-4000-a09c-88892bd00092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:57.834250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2361-8851-4000-a09c-88892bd00092 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.834628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2361-8851-4000-a09c-88892bd00092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.834910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2361-8851-4000-a09c-88892bd00092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.835644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2361-8851-4000-a09c-88892bd00092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:57.837325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2361-8851-4000-a09c-88892bd00092 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:57.849537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 946/1931] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:57.853862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:57.864164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb392-c507-4d50-ab7b-4587d76c91b9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:57.868962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:57.869841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.870117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.870390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] PATH_INFO: `/v3/projects/a638cee6417b44d1ab887f99cc25a30e/users/a0b877b3e0f44613a90e696caadea7f7/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.884690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a638cee6417b44d1ab887f99cc25a30e, user_id=a0b877b3e0f44613a90e696caadea7f7, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:57.887338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:57.902380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 986/1932] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:57 2022] PUT /identity/v3/projects/a638cee6417b44d1ab887f99cc25a30e/users/a0b877b3e0f44613a90e696caadea7f7/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:57.912808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365d139-6bf5-43fe-b147-30a73b1841e7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:57.913301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365d139-6bf5-43fe-b147-30a73b1841e7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:57.913421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365d139-6bf5-43fe-b147-30a73b1841e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:57.941353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7365d139-6bf5-43fe-b147-30a73b1841e7 None None] MFA Rules not processed for user `a0b877b3e0f44613a90e696caadea7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:57.942627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7365d139-6bf5-43fe-b147-30a73b1841e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:58.008411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 947/1933] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:58.013239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.081177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c5c9-e10c-4f91-9dd7-8c2f45ab1bfa admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.086942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.087616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.087896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.088209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.088908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.092462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.122474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 987/1934] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:58 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:58.126997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365d139-6bf5-43fe-b147-30a73b1841e7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.139433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365d139-6bf5-43fe-b147-30a73b1841e7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.207601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.208315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.208596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.208892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.209561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.211501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.237843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 948/1935] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:58 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:58.239103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.249870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc3ca-fb05-4588-b7bf-366daa6ac55f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.255397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.256170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.256521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.256882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.257693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.259532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.270464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 988/1936] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:58.274252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.284590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1dbbf-6a1f-4884-9bbd-4edcee37cd50 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.289668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da9b3-ef8c-456b-bc2d-3980a4e70522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.290178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da9b3-ef8c-456b-bc2d-3980a4e70522 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.290461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da9b3-ef8c-456b-bc2d-3980a4e70522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.290731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da9b3-ef8c-456b-bc2d-3980a4e70522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.291455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3da9b3-ef8c-456b-bc2d-3980a4e70522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.293070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3da9b3-ef8c-456b-bc2d-3980a4e70522 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.309206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 949/1937] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:58.313595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.323893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9436a39-faa7-4d7e-a7e9-439e7c454d8d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.331466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.332993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.333369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.333812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] PATH_INFO: `/v3/projects/e08c3ac87d794c47b4fd758ddd948dff/users/f37339728a544aaaa3ba8492251d461e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.353789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08c3ac87d794c47b4fd758ddd948dff, user_id=f37339728a544aaaa3ba8492251d461e, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.356506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.373287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 989/1938] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:58 2022] PUT /identity/v3/projects/e08c3ac87d794c47b4fd758ddd948dff/users/f37339728a544aaaa3ba8492251d461e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:58.383502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae970-4f75-4481-b848-c43ba8d139f1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.383790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae970-4f75-4481-b848-c43ba8d139f1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.384095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae970-4f75-4481-b848-c43ba8d139f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.412566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f55ae970-4f75-4481-b848-c43ba8d139f1 None None] MFA Rules not processed for user `f37339728a544aaaa3ba8492251d461e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:58.413785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f55ae970-4f75-4481-b848-c43ba8d139f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:58.482186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 950/1939] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:58.487097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.556222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15384379-fbd2-41dd-9540-d63ae873e50d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.561219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.561901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.562172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.562446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.563287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.565215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.592303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 990/1940] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:54:58 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:58.596389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ae970-4f75-4481-b848-c43ba8d139f1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.608162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ae970-4f75-4481-b848-c43ba8d139f1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.663958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.664649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.664931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.665207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.665904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.668088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.693515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 951/1941] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:54:58 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:58.694963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.706234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524954dd-3ce7-4adc-9e47-ef2e2b3fa32e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.711351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.712067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.712356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.712633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.713373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.715074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.729317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 991/1942] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:54:58.731078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.742492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350d5c-0089-4f02-b1b8-fc4a2cd1c387 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.748996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.750023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.750300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.750573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] PATH_INFO: `/v3/projects/43c56ba6930a4d81b91d26c91dd9ea9d/users/1c8f3ffb84434f33b2ee31b0ff613237/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.765287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c56ba6930a4d81b91d26c91dd9ea9d, user_id=1c8f3ffb84434f33b2ee31b0ff613237, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.768012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.782250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 952/1943] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:58 2022] PUT /identity/v3/projects/43c56ba6930a4d81b91d26c91dd9ea9d/users/1c8f3ffb84434f33b2ee31b0ff613237/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:54:58.786320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.796636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444bf82-c290-4f60-9079-10f7e3a3822e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.852518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a51c0-fe92-47a6-a27d-bc98e4253ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.853120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a51c0-fe92-47a6-a27d-bc98e4253ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.853423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a51c0-fe92-47a6-a27d-bc98e4253ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.853713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a51c0-fe92-47a6-a27d-bc98e4253ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.854416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a51c0-fe92-47a6-a27d-bc98e4253ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.856116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a51c0-fe92-47a6-a27d-bc98e4253ac8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.866050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 992/1944] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:58.870262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:58.880287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a036d8-afc0-4a06-a90a-790de8f16370 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:58.884905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:58.885802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.886084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.886361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] PATH_INFO: `/v3/projects/43c56ba6930a4d81b91d26c91dd9ea9d/users/1c8f3ffb84434f33b2ee31b0ff613237/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.888396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c56ba6930a4d81b91d26c91dd9ea9d, user_id=1c8f3ffb84434f33b2ee31b0ff613237, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:58.891267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:58.901733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 953/1945] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:54:58 2022] PUT /identity/v3/projects/43c56ba6930a4d81b91d26c91dd9ea9d/users/1c8f3ffb84434f33b2ee31b0ff613237/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:58.913199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:58.913518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:58.913793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:58.939421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] MFA Rules not processed for user `1c8f3ffb84434f33b2ee31b0ff613237`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:58.940667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:59.025435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 993/1946] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:54:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:54:59.038853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:59.040844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:59.109428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aed9b-b795-4ca7-9842-4a637eca1b0d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:59.114082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:59.114730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:59.114992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:59.115259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:59.174543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:59.176030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:59.184846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 954/1947] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:54:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:02.828612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:02.830965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:02.843694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633eae8-3915-47ae-b7dc-813d166179cf None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:02.847937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:02.848685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:02.849029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:02.849744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:02.913809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:02.915561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:02.924609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 994/1948] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:03.577336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:03.585829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64b26-ed59-42c8-8703-23b1d54a4ded service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:03.589787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8ec80-f819-47ec-a369-16ead75006db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:03.590552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8ec80-f819-47ec-a369-16ead75006db service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:03.590842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8ec80-f819-47ec-a369-16ead75006db service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:03.591117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8ec80-f819-47ec-a369-16ead75006db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:03.601389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8ec80-f819-47ec-a369-16ead75006db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:03.602869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8ec80-f819-47ec-a369-16ead75006db service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:03.613519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 955/1949] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:04.457895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:04.459435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:04.555891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127965-7dbd-415b-ae4b-93400e695d67 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:04.560475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:04.561604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:04.562142 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:04.562810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] PATH_INFO: `/v3/users/e2c1ee271ba04a4fa193699551f5e7cd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:04.564494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c1ee271ba04a4fa193699551f5e7cd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:04.566510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:04.625108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c1ee271ba04a4fa193699551f5e7cd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:04.639138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c1ee271ba04a4fa193699551f5e7cd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:04.658027 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c1ee271ba04a4fa193699551f5e7cd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:04.665590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c1ee271ba04a4fa193699551f5e7cd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:04.666370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c1ee271ba04a4fa193699551f5e7cd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:04.672702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 995/1950] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:04 2022] DELETE /identity/v3/users/e2c1ee271ba04a4fa193699551f5e7cd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:04.677801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:04.680094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:04.680718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:04.705054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:04.706527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:04.799623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 956/1951] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:04.815595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:04.822440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:04.899407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41c7b-b191-4e62-9695-586f1b77b881 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:04.903559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:04.905509 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:04.905857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:04.906303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:04.923716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:04.928980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:04.945560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 996/1952] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:05.423488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:05.425267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:05.440596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41dc49-24b7-4931-8fc7-2d3da1ac9ffb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:05.449602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:05.450502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:05.450780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:05.451050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] PATH_INFO: `/v3/projects/1c0347615d084040b02015be4fd4b692` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:05.452453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0347615d084040b02015be4fd4b692)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:05.454768 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:05.508430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0347615d084040b02015be4fd4b692', 'request_id': 'req-7b5f606e-7cdc-40bd-b136-b373b555345e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.515558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0347615d084040b02015be4fd4b692', 'request_id': 'req-7b5f606e-7cdc-40bd-b136-b373b555345e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.523755 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0347615d084040b02015be4fd4b692', 'request_id': 'req-7b5f606e-7cdc-40bd-b136-b373b555345e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.534553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] The token cache is being invalidate because project 1c0347615d084040b02015be4fd4b692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:05.534847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.535529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.537147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 957/1953] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:05 2022] DELETE /identity/v3/projects/1c0347615d084040b02015be4fd4b692 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:05.541036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:05.552853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a4f4d-d8dd-4d09-b78d-0a33a64f5bf5 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:05.629543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:05.631195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:05.631701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:05.631837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] PATH_INFO: `/v3/users/d1d415111ddf45cbb86c2078ed0880a6` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:05.633256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d415111ddf45cbb86c2078ed0880a6)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:05.635320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:05.704076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d415111ddf45cbb86c2078ed0880a6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.717247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d415111ddf45cbb86c2078ed0880a6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.734889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d415111ddf45cbb86c2078ed0880a6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.743164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d415111ddf45cbb86c2078ed0880a6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.743962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-58f2ea5a-b892-4653-b167-2b3a3897ac63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d415111ddf45cbb86c2078ed0880a6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:05.750463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 997/1954] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:05 2022] DELETE /identity/v3/users/d1d415111ddf45cbb86c2078ed0880a6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:06.746087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:06.748619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:06.764994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f606e-7cdc-40bd-b136-b373b555345e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:06.857273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:06.858582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:06.859080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:06.859576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] PATH_INFO: `/v3/projects/2ff1dc400a364536b5519ba6964bff1d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:06.861080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff1dc400a364536b5519ba6964bff1d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:06.863269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:06.938835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff1dc400a364536b5519ba6964bff1d', 'request_id': 'req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:06.946864 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff1dc400a364536b5519ba6964bff1d', 'request_id': 'req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:06.958220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff1dc400a364536b5519ba6964bff1d', 'request_id': 'req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:06.972420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] The token cache is being invalidate because project 2ff1dc400a364536b5519ba6964bff1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:06.973318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:06.974152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c4bbe75-8ea5-4c2f-8e21-3825f4bddb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:06.977041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 958/1955] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:06 2022] DELETE /identity/v3/projects/2ff1dc400a364536b5519ba6964bff1d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:06.983781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19480ffc-a30f-46cd-91f3-c77695a32f74 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:06.985050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19480ffc-a30f-46cd-91f3-c77695a32f74 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:06.985598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19480ffc-a30f-46cd-91f3-c77695a32f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.008051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-19480ffc-a30f-46cd-91f3-c77695a32f74 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:07.009287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-19480ffc-a30f-46cd-91f3-c77695a32f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.111619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 998/1956] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:07.121202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.121495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.121910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.142795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:07.144238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.153352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 959/1957] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:07.160485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19480ffc-a30f-46cd-91f3-c77695a32f74 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.173139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19480ffc-a30f-46cd-91f3-c77695a32f74 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.179524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.180613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.181123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.181579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.183160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:07.183668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.185856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.191807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.198207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.204072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 999/1958] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:55:07.209643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.211403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da0e1-cc3e-4a2b-a463-75bc78aa36e2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.216809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.217139 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.217414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.217690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] PATH_INFO: `/v3/users/6123374bf3634593b549d6621b6a4d1c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.219481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6123374bf3634593b549d6621b6a4d1c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.221655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.222189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6e14-ab7b-4fc3-9214-139eb5daf034 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.229743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.231197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.231485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.231764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.232550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.234670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.266691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1000/1959] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:07 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:07.271070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.281872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6123374bf3634593b549d6621b6a4d1c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.292530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6123374bf3634593b549d6621b6a4d1c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.293303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6123374bf3634593b549d6621b6a4d1c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.314729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6123374bf3634593b549d6621b6a4d1c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.315895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6123374bf3634593b549d6621b6a4d1c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.333836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 960/1960] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:07 2022] DELETE /identity/v3/users/6123374bf3634593b549d6621b6a4d1c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:07.385389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858f2cf-4d99-4725-9a29-da90f62ac946 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.465557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.466423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.466799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.467177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.468003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.470279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.498085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1001/1961] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:07 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:07.502290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.504578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.528629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87708f2e-0773-4d01-8e94-8241c7dc2f8c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.534516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.535459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.535837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.536267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.537218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.541826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.547438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.549748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.552929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 961/1962] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:07.556912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.568927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0f049-34ba-4a3a-b16e-2ab6df4480d0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.569214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738e8ff-0564-41f5-ad9b-16faa323591b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.575143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.576177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.576667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.577597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.578157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.579601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.580297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.581397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.581986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.582750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] PATH_INFO: `/v3/projects/a290c78963aa478587aa2dabb23ef83e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.585386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a290c78963aa478587aa2dabb23ef83e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.588786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.595942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 962/1963] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:07.597306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.607562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e75548-0f77-4c37-a59b-8a05a13ed943 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.614483 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fb8d8-ef1f-46aa-880e-330eb27b23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.615463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fb8d8-ef1f-46aa-880e-330eb27b23c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.615817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fb8d8-ef1f-46aa-880e-330eb27b23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.616188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fb8d8-ef1f-46aa-880e-330eb27b23c0 admin admin] PATH_INFO: `/v3/projects/daaf2ceb389c49a3be66daf4c4c86a85/users/a3cdb48568b84272afd8d9b3c7f3ed67/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.633007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fb8d8-ef1f-46aa-880e-330eb27b23c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daaf2ceb389c49a3be66daf4c4c86a85, user_id=a3cdb48568b84272afd8d9b3c7f3ed67, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.635965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fb8d8-ef1f-46aa-880e-330eb27b23c0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.656276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 963/1964] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:07 2022] PUT /identity/v3/projects/daaf2ceb389c49a3be66daf4c4c86a85/users/a3cdb48568b84272afd8d9b3c7f3ed67/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:07.660228 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a290c78963aa478587aa2dabb23ef83e', 'request_id': 'req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.672578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a290c78963aa478587aa2dabb23ef83e', 'request_id': 'req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.672832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.673290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.673745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.693688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a290c78963aa478587aa2dabb23ef83e', 'request_id': 'req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.713085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] The token cache is being invalidate because project a290c78963aa478587aa2dabb23ef83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:07.713661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.714611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.716292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] MFA Rules not processed for user `a3cdb48568b84272afd8d9b3c7f3ed67`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:07.718565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.723081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1002/1965] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:07 2022] DELETE /identity/v3/projects/a290c78963aa478587aa2dabb23ef83e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:07.725080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.727118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.828475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142a9e-7cd4-4fe3-a786-8e4f5b8fbbe2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.829773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 964/1966] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:07.841633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.843599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.892991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.893993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.894352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.894693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] PATH_INFO: `/v3/users/92af66ab064f46689c5e67f09e4bf8d9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.896108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92af66ab064f46689c5e67f09e4bf8d9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.898169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.920830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c17b-93a5-4b6a-9a32-137b4880cc0c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.927686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.929223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.930671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.932001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.943163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.946356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.960521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 965/1967] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:07.962840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:07.964603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:07.982758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33e14-82f3-49d7-81e2-e9135adbc621 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:07.986943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92af66ab064f46689c5e67f09e4bf8d9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:07.988167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:07.989352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:07.989885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:07.990359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] PATH_INFO: `/v3/users/a0b877b3e0f44613a90e696caadea7f7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:07.991841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b877b3e0f44613a90e696caadea7f7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:07.995362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:07.999164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92af66ab064f46689c5e67f09e4bf8d9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.016384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92af66ab064f46689c5e67f09e4bf8d9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.024979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92af66ab064f46689c5e67f09e4bf8d9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.026699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-12df8670-f547-4d4b-a730-8081011a7753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92af66ab064f46689c5e67f09e4bf8d9'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.036586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1003/1968] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:07 2022] DELETE /identity/v3/users/92af66ab064f46689c5e67f09e4bf8d9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:08.074030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b877b3e0f44613a90e696caadea7f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.085891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b877b3e0f44613a90e696caadea7f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.086873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b877b3e0f44613a90e696caadea7f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.109242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b877b3e0f44613a90e696caadea7f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.110129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b877b3e0f44613a90e696caadea7f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.152966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 966/1969] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:07 2022] DELETE /identity/v3/users/a0b877b3e0f44613a90e696caadea7f7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:08.154928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:08.155639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:08.156455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:08.179455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:08.181003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:08.271917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1004/1970] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:08.285913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:08.288199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:08.436633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c8cd4-5ab5-457f-9fcb-84de50b7d86d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:08.446136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc084c-e5a0-4c53-ab0f-ff01f18768ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:08.446830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc084c-e5a0-4c53-ab0f-ff01f18768ab service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:08.447111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc084c-e5a0-4c53-ab0f-ff01f18768ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:08.447383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc084c-e5a0-4c53-ab0f-ff01f18768ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:08.459239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc084c-e5a0-4c53-ab0f-ff01f18768ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:08.461042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc084c-e5a0-4c53-ab0f-ff01f18768ab service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:08.477441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 967/1971] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:08.589029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:08.591529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:08.613979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcff57-90a8-4aa0-8cf8-da884e50fe5b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:08.625897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:08.628122 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:08.628707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:08.629127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] PATH_INFO: `/v3/projects/4ea6ef0013b94746b3bf268a8ad1d469` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:08.630699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea6ef0013b94746b3bf268a8ad1d469)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:08.633930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:08.745424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea6ef0013b94746b3bf268a8ad1d469', 'request_id': 'req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.765479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea6ef0013b94746b3bf268a8ad1d469', 'request_id': 'req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.791908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea6ef0013b94746b3bf268a8ad1d469', 'request_id': 'req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.814160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] The token cache is being invalidate because project 4ea6ef0013b94746b3bf268a8ad1d469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:08.815344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.817838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:08.824003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1005/1972] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:08 2022] DELETE /identity/v3/projects/4ea6ef0013b94746b3bf268a8ad1d469 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:08.826029 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142e38d-5fb0-4c22-b548-102070e100ad None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:08.826337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142e38d-5fb0-4c22-b548-102070e100ad None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:08.826625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142e38d-5fb0-4c22-b548-102070e100ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:08.921622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e142e38d-5fb0-4c22-b548-102070e100ad None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:08.925980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e142e38d-5fb0-4c22-b548-102070e100ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:09.086209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.087814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:09.111981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 968/1973] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:09.119816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d488c-ca83-43bc-b3c8-7c72469ebcca None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.120393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d488c-ca83-43bc-b3c8-7c72469ebcca None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.120672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d488c-ca83-43bc-b3c8-7c72469ebcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.154505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8c3d488c-ca83-43bc-b3c8-7c72469ebcca None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:09.156122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8c3d488c-ca83-43bc-b3c8-7c72469ebcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:09.167458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 969/1974] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:09.171679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d488c-ca83-43bc-b3c8-7c72469ebcca None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.180474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e4323-37dd-4b8a-9c43-a0690ac5395c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.184174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d488c-ca83-43bc-b3c8-7c72469ebcca None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.186038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.186979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.187462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.187850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] PATH_INFO: `/v3/projects/a638cee6417b44d1ab887f99cc25a30e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.189167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a638cee6417b44d1ab887f99cc25a30e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.191398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.195519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.196706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.197291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.197846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.200449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:09.201361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.206444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.220750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 970/1975] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:55:09.225485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.236813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363123-28ed-40e2-bc3e-078f2dd008cb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.242491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.243357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.243676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.244139 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.245212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.247911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.268557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a638cee6417b44d1ab887f99cc25a30e', 'request_id': 'req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.283431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a638cee6417b44d1ab887f99cc25a30e', 'request_id': 'req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.292040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a638cee6417b44d1ab887f99cc25a30e', 'request_id': 'req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.302036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] The token cache is being invalidate because project a638cee6417b44d1ab887f99cc25a30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:09.302324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.302992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.304902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1006/1976] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:09 2022] DELETE /identity/v3/projects/a638cee6417b44d1ab887f99cc25a30e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:09.306459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 971/1977] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:09 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:09.308439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.309807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:09.310203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.311792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:09.387814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25ae9f-3ede-45f1-afeb-1f5164b8db8e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.393337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.394261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.394539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.394813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] PATH_INFO: `/v3/users/f37339728a544aaaa3ba8492251d461e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.394917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb974f7f-71d2-4cd8-b194-68be0cdb0b35 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.396148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37339728a544aaaa3ba8492251d461e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.398114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.399573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.400282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.400564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.400838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.401536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.403476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.429716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 972/1978] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:09 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:55:09.434795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.456405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c243-a654-4afc-9940-ff6cbacac63b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.457193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37339728a544aaaa3ba8492251d461e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.469714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.470941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.483028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.483662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.485007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37339728a544aaaa3ba8492251d461e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.485348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.488480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.503684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37339728a544aaaa3ba8492251d461e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.511409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37339728a544aaaa3ba8492251d461e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.512213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37339728a544aaaa3ba8492251d461e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:09.523200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1007/1979] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:09 2022] DELETE /identity/v3/users/f37339728a544aaaa3ba8492251d461e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:09.523565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 973/1980] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:55:09.527230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.528777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:09.643543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde183f6-f6f0-409f-a0ca-c756fe69bd76 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.649504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b7d1-9cbe-4d90-99fd-5410e27cbd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.651537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b7d1-9cbe-4d90-99fd-5410e27cbd85 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.652186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b7d1-9cbe-4d90-99fd-5410e27cbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.653053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b7d1-9cbe-4d90-99fd-5410e27cbd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.654536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b7d1-9cbe-4d90-99fd-5410e27cbd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.658868 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b7d1-9cbe-4d90-99fd-5410e27cbd85 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.674063 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1008/1981] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:09.677048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.694221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e277a2b-323f-4074-8972-43c241b0e2fb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:09.702511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:09.704058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.704475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.704783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] PATH_INFO: `/v3/projects/0c3f95cf5153409fa2a8935c7d8c99c3/users/3769ab630877459098505dacc3b2f098/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.738624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3f95cf5153409fa2a8935c7d8c99c3, user_id=3769ab630877459098505dacc3b2f098, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:09.761209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:09.800408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 974/1982] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:09 2022] PUT /identity/v3/projects/0c3f95cf5153409fa2a8935c7d8c99c3/users/3769ab630877459098505dacc3b2f098/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:09.802240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:09.802727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:09.803183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:09.858703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] MFA Rules not processed for user `3769ab630877459098505dacc3b2f098`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:09.860864 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:09.939771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1009/1983] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:09.951306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:09.953909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:10.017182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec057a3-917c-4fa9-9162-9e07d597db19 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:10.021494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:10.022237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:10.022578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:10.022935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:10.032291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:10.033765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:10.034554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:10.035469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:10.047414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 975/1984] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:10.068711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:10.177227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5e5de-c18f-48b1-a1da-db304d84066a service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:10.178542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f740ab-e074-41b3-8417-d284a30a4e0e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:10.183630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:10.186822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:10.187086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:10.187449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:10.187599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] PATH_INFO: `/v3/projects/e08c3ac87d794c47b4fd758ddd948dff` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:10.189324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:10.189653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08c3ac87d794c47b4fd758ddd948dff)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:10.189781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:10.190071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] PATH_INFO: `/v3/users/3769ab630877459098505dacc3b2f098` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:10.191349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3769ab630877459098505dacc3b2f098)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:10.192094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:10.193466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:10.245610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3769ab630877459098505dacc3b2f098'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.247715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08c3ac87d794c47b4fd758ddd948dff', 'request_id': 'req-7df8dd25-f727-44a6-8204-40c8cf617678'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.252775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3769ab630877459098505dacc3b2f098'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.253511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3769ab630877459098505dacc3b2f098'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.254406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08c3ac87d794c47b4fd758ddd948dff', 'request_id': 'req-7df8dd25-f727-44a6-8204-40c8cf617678'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.264841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08c3ac87d794c47b4fd758ddd948dff', 'request_id': 'req-7df8dd25-f727-44a6-8204-40c8cf617678'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.268293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3769ab630877459098505dacc3b2f098'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.269091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a23fef9-776e-4582-a733-986d61352e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3769ab630877459098505dacc3b2f098'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.278216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] The token cache is being invalidate because project e08c3ac87d794c47b4fd758ddd948dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:10.278590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.279349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.281543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1010/1985] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:10 2022] DELETE /identity/v3/projects/e08c3ac87d794c47b4fd758ddd948dff => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:10.287568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 976/1986] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:10 2022] DELETE /identity/v3/users/3769ab630877459098505dacc3b2f098 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:10.287744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:10.287744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:10.289722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:10.289884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:10.290327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:10.310146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:10.311369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:10.364970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8dd25-f727-44a6-8204-40c8cf617678 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:10.378575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 977/1987] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:55:10.390608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:10.392909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:10.426260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:10.427214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:10.427507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:10.427783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] PATH_INFO: `/v3/users/1c8f3ffb84434f33b2ee31b0ff613237` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:10.429110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8f3ffb84434f33b2ee31b0ff613237)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:10.431046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:10.467270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1cb06-45dc-4785-8488-3e6d77f6d4ee None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:10.479474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:10.480299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:10.480729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:10.481040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:10.484791 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8f3ffb84434f33b2ee31b0ff613237'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.491192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:10.492763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:10.496089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8f3ffb84434f33b2ee31b0ff613237'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.503108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 978/1988] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:10.514694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8f3ffb84434f33b2ee31b0ff613237'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.522245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8f3ffb84434f33b2ee31b0ff613237'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.523001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8f3ffb84434f33b2ee31b0ff613237'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:10.529460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1011/1989] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:10 2022] DELETE /identity/v3/users/1c8f3ffb84434f33b2ee31b0ff613237 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:10.799093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:10.800614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:10.817002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099b12d-e315-458d-a7db-ebc5d111caf5 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:10.925987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:10.926908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:10.927673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:10.927988 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] PATH_INFO: `/v3/projects/0c3f95cf5153409fa2a8935c7d8c99c3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:10.930160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c3f95cf5153409fa2a8935c7d8c99c3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:10.932150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:10.966588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:10.968070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:10.989389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb24f71-13e9-47a1-9f5d-ad46b14f550a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.010373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c3f95cf5153409fa2a8935c7d8c99c3', 'request_id': 'req-bd23c698-6cd7-4ebc-939e-fa73dd578364'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.019077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c3f95cf5153409fa2a8935c7d8c99c3', 'request_id': 'req-bd23c698-6cd7-4ebc-939e-fa73dd578364'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.030594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c3f95cf5153409fa2a8935c7d8c99c3', 'request_id': 'req-bd23c698-6cd7-4ebc-939e-fa73dd578364'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.046795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] The token cache is being invalidate because project 0c3f95cf5153409fa2a8935c7d8c99c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:11.047173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.048364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd23c698-6cd7-4ebc-939e-fa73dd578364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.050872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 979/1990] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:10 2022] DELETE /identity/v3/projects/0c3f95cf5153409fa2a8935c7d8c99c3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:11.057126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b5c3-3727-4709-ab30-8e52564f4262 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.057637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b5c3-3727-4709-ab30-8e52564f4262 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.057757 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b5c3-3727-4709-ab30-8e52564f4262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.069376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.070510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.070795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.071081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] PATH_INFO: `/v3/projects/43c56ba6930a4d81b91d26c91dd9ea9d` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.072300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c56ba6930a4d81b91d26c91dd9ea9d)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.074516 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.077630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5ec4b5c3-3727-4709-ab30-8e52564f4262 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:11.079295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5ec4b5c3-3727-4709-ab30-8e52564f4262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:11.087322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 980/1991] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:55:11.096674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ada1ad-147b-4899-b589-1dd74fd2c3bb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.097061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ada1ad-147b-4899-b589-1dd74fd2c3bb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.097438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ada1ad-147b-4899-b589-1dd74fd2c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.128522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-85ada1ad-147b-4899-b589-1dd74fd2c3bb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:11.129268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c56ba6930a4d81b91d26c91dd9ea9d', 'request_id': 'req-31c6cceb-23df-4f11-b62f-e676c2fdf23b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.129956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-85ada1ad-147b-4899-b589-1dd74fd2c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:11.136654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c56ba6930a4d81b91d26c91dd9ea9d', 'request_id': 'req-31c6cceb-23df-4f11-b62f-e676c2fdf23b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.146845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c56ba6930a4d81b91d26c91dd9ea9d', 'request_id': 'req-31c6cceb-23df-4f11-b62f-e676c2fdf23b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.161357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] The token cache is being invalidate because project 43c56ba6930a4d81b91d26c91dd9ea9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:11.161910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.162798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31c6cceb-23df-4f11-b62f-e676c2fdf23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:11.165345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1012/1992] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:10 2022] DELETE /identity/v3/projects/43c56ba6930a4d81b91d26c91dd9ea9d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:11.170471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d518da-583a-4b3d-88f0-8196f9a6b1ea None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.171500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d518da-583a-4b3d-88f0-8196f9a6b1ea None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.171823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d518da-583a-4b3d-88f0-8196f9a6b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.193603 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-18d518da-583a-4b3d-88f0-8196f9a6b1ea None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:11.194824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-18d518da-583a-4b3d-88f0-8196f9a6b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:11.203562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 981/1993] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:11.207683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ada1ad-147b-4899-b589-1dd74fd2c3bb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.217619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ada1ad-147b-4899-b589-1dd74fd2c3bb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.222929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.223601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.223898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.224185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.225278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:11.225587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.227237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.242300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 982/1994] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:55:11.243338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.253457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb182a9-64c2-409d-ad72-4945402735e3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.259334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.260217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.260506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.260782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.261470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.263396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.266728 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1013/1995] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:11.277859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921c84-0618-4603-87e2-f06daa2b5936 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.278165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921c84-0618-4603-87e2-f06daa2b5936 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.278425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921c84-0618-4603-87e2-f06daa2b5936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.299008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cf921c84-0618-4603-87e2-f06daa2b5936 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:11.300514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cf921c84-0618-4603-87e2-f06daa2b5936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:11.309312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 983/1996] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:55:11.310859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.316380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1014/1997] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:11.321437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921c84-0618-4603-87e2-f06daa2b5936 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.338072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921c84-0618-4603-87e2-f06daa2b5936 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.404296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af9395-fdcf-432e-bb11-f0278fb4bf6c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.414464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.415168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.415449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.415724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.416744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.419192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.426392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.427362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.427645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.427952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.428696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:11.429004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.430732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.445688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 984/1998] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:11.452488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.452919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1015/1999] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:55:11.453810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.466218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724453ad-c4e2-49e3-bdcb-475693e46ba0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.468104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177d8ca-5f04-4501-b87b-e87925567c7f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.472695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.473765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.474055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.474330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.475550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.477567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.482230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.482948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.483232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.483582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.484560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.486145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.497312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 985/2000] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:11.501678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.519921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298ae8-545b-4ac7-b1c3-fd0ae12ce6c4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.523317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1016/2001] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:11.527465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.529254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.529962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.530246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.530529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.531983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.535095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.549154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 986/2002] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:11.553053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.566255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a052e-f2bd-45d9-95f3-2b736374dec4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.612583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d9aca-aa37-473d-8814-67789036af9a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.620040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.621013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.621473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.621955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.622993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.625789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.643371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe0f3c-bc05-4221-ba64-6e410953ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.644810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0f3c-bc05-4221-ba64-6e410953ecac admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.645320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0f3c-bc05-4221-ba64-6e410953ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.645733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe0f3c-bc05-4221-ba64-6e410953ecac admin admin] PATH_INFO: `/v3/projects/8ebdf4d2ea804db2960d293c9fec1195/users/e3652f6152b14c6c97b6750e0cbd66f1/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.655661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1017/2003] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:11.659989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.670595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe0f3c-bc05-4221-ba64-6e410953ecac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ebdf4d2ea804db2960d293c9fec1195, user_id=e3652f6152b14c6c97b6750e0cbd66f1, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.675440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe0f3c-bc05-4221-ba64-6e410953ecac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.686269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e4705-80c3-4815-a353-1f7ec1134991 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.695454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 987/2004] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:11 2022] PUT /identity/v3/projects/8ebdf4d2ea804db2960d293c9fec1195/users/e3652f6152b14c6c97b6750e0cbd66f1/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:11.709147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.709824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.710250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.744300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] MFA Rules not processed for user `e3652f6152b14c6c97b6750e0cbd66f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:11.746410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:11.782407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.783618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.784188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.785135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.786421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.789634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.804932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1018/2005] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:11.808574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.821901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923713d-2a08-4471-b75d-2ebadffb9729 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.827093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.828057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.828489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.828777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.829602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.831318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.841578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 988/2006] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:55:11.852909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1019/2007] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:55:11.856445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.856604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:11.858146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:11.869928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9b6f-3706-4821-806b-99b608cbd768 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.875439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027d8a-7efd-487a-8a41-2b8114d2dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:11.876821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027d8a-7efd-487a-8a41-2b8114d2dc54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.877421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027d8a-7efd-487a-8a41-2b8114d2dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.877839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027d8a-7efd-487a-8a41-2b8114d2dc54 admin admin] PATH_INFO: `/v3/projects/234fad3b48934311b7320ebddbfae18c/users/b3560ef88ff44c42bb3a71d4aff15b04/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.898962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9027d8a-7efd-487a-8a41-2b8114d2dc54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234fad3b48934311b7320ebddbfae18c, user_id=b3560ef88ff44c42bb3a71d4aff15b04, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:11.903467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9027d8a-7efd-487a-8a41-2b8114d2dc54 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:11.929291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1020/2008] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:11 2022] PUT /identity/v3/projects/234fad3b48934311b7320ebddbfae18c/users/b3560ef88ff44c42bb3a71d4aff15b04/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:11.942318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:11.942597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:11.943819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:11.959321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06f95-c258-4d10-884a-ee98f273f6ab None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:11.975344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] MFA Rules not processed for user `b3560ef88ff44c42bb3a71d4aff15b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:11.976648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:12.038129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:12.039635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:12.040133 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:12.041125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:12.051369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1021/2009] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:12.067275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:12.068864 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:12.116813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:12.118333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:12.131958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 989/2010] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:12.152330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb0e09-9f20-43cc-808e-4dd10ce11810 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:12.157494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec374-a767-428c-95e4-19496dc57752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:12.158798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec374-a767-428c-95e4-19496dc57752 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:12.159085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec374-a767-428c-95e4-19496dc57752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:12.159354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec374-a767-428c-95e4-19496dc57752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:12.184839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec374-a767-428c-95e4-19496dc57752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:12.187039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec374-a767-428c-95e4-19496dc57752 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:12.199528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1022/2011] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:55:12.233156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:12.318843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df1015-77e8-4e94-a477-752ae3774042 service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:12.325810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:12.326710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:12.326991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:12.327265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] PATH_INFO: `/v3/users/b3560ef88ff44c42bb3a71d4aff15b04` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:12.328631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3560ef88ff44c42bb3a71d4aff15b04)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:12.330895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:12.407357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3560ef88ff44c42bb3a71d4aff15b04'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:12.428852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3560ef88ff44c42bb3a71d4aff15b04'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:12.432537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3560ef88ff44c42bb3a71d4aff15b04'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:12.453621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3560ef88ff44c42bb3a71d4aff15b04'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:12.455201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3560ef88ff44c42bb3a71d4aff15b04'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:12.483914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 990/2012] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:12 2022] DELETE /identity/v3/users/b3560ef88ff44c42bb3a71d4aff15b04 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:12.485831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:12.486132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:12.486416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:12.518065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:12.519616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:12.593764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1023/2013] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:12.604024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:12.605471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:12.670409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9d0c-46dc-4eed-938f-30868405e06d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:12.674987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:12.675782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:12.676120 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:12.676504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:12.692985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:12.695000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:12.707117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 991/2014] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:13.117305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:13.118697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:13.137092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c34d-de6c-445a-b9c6-1e09a149322c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:13.143110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:13.143938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:13.144326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:13.144703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] PATH_INFO: `/v3/projects/234fad3b48934311b7320ebddbfae18c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:13.146282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=234fad3b48934311b7320ebddbfae18c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:13.148444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:13.219535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234fad3b48934311b7320ebddbfae18c', 'request_id': 'req-77115920-0f07-40e0-ad63-52cba1b44205'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:13.228518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234fad3b48934311b7320ebddbfae18c', 'request_id': 'req-77115920-0f07-40e0-ad63-52cba1b44205'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:13.241229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234fad3b48934311b7320ebddbfae18c', 'request_id': 'req-77115920-0f07-40e0-ad63-52cba1b44205'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:13.258960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] The token cache is being invalidate because project 234fad3b48934311b7320ebddbfae18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:13.259398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:13.260345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-77115920-0f07-40e0-ad63-52cba1b44205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:13.262864 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1024/2015] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:13 2022] DELETE /identity/v3/projects/234fad3b48934311b7320ebddbfae18c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:40.522374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:40.523784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:40.536352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e91e-2f7b-4833-8c0b-3b8c765bd703 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:40.598506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:40.599395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:40.599699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:40.600007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] PATH_INFO: `/v3/users/a3cdb48568b84272afd8d9b3c7f3ed67` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:40.601238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cdb48568b84272afd8d9b3c7f3ed67)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:40.603523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:40.652420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cdb48568b84272afd8d9b3c7f3ed67'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:40.658341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cdb48568b84272afd8d9b3c7f3ed67'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:40.659017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cdb48568b84272afd8d9b3c7f3ed67'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:40.670232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cdb48568b84272afd8d9b3c7f3ed67'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:40.671344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cdb48568b84272afd8d9b3c7f3ed67'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:40.690567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 992/2016] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:40 2022] DELETE /identity/v3/users/a3cdb48568b84272afd8d9b3c7f3ed67 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:40.695095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:40.695653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:40.695653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:40.713494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:40.714708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:40.773893 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1025/2017] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:40.787423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:40.789518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:40.858866 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b73e-13d1-4292-92b1-7f1d354e1d06 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:40.863697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77358a-ecc6-462b-b69f-3b7fc88cacda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:40.864412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77358a-ecc6-462b-b69f-3b7fc88cacda service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:40.864696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77358a-ecc6-462b-b69f-3b7fc88cacda service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:40.864980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77358a-ecc6-462b-b69f-3b7fc88cacda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:40.874954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77358a-ecc6-462b-b69f-3b7fc88cacda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:40.876476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77358a-ecc6-462b-b69f-3b7fc88cacda service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:40.886020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 993/2018] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:41.173461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.174912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:41.188246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5bc5e-8796-44af-830c-932b3d15b6b6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.193222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.194100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.194384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.194662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] PATH_INFO: `/v3/projects/daaf2ceb389c49a3be66daf4c4c86a85` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.195887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=daaf2ceb389c49a3be66daf4c4c86a85)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.197805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.250628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daaf2ceb389c49a3be66daf4c4c86a85', 'request_id': 'req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:41.256732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daaf2ceb389c49a3be66daf4c4c86a85', 'request_id': 'req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:41.266180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daaf2ceb389c49a3be66daf4c4c86a85', 'request_id': 'req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:41.276806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] The token cache is being invalidate because project daaf2ceb389c49a3be66daf4c4c86a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:41.277094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:41.277838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-263b9bc5-037a-49dd-b25a-85ffdc5dcb4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:41.279538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1026/2019] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:41 2022] DELETE /identity/v3/projects/daaf2ceb389c49a3be66daf4c4c86a85 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:41.284871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9248c-85d4-44e8-abde-9cebb5265d25 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.285162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9248c-85d4-44e8-abde-9cebb5265d25 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.285441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9248c-85d4-44e8-abde-9cebb5265d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.305105 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cac9248c-85d4-44e8-abde-9cebb5265d25 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:41.306326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cac9248c-85d4-44e8-abde-9cebb5265d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:41.367364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 994/2020] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:41.376200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475aed04-a598-4da3-bbbe-45bf47e9ce17 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.376514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475aed04-a598-4da3-bbbe-45bf47e9ce17 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.376876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475aed04-a598-4da3-bbbe-45bf47e9ce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.400155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-475aed04-a598-4da3-bbbe-45bf47e9ce17 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:41.401372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-475aed04-a598-4da3-bbbe-45bf47e9ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:41.411074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1027/2021] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:41.417367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9248c-85d4-44e8-abde-9cebb5265d25 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.432031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9248c-85d4-44e8-abde-9cebb5265d25 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.439054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.439714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.440036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.440307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.441416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:41.441726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.443358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.456010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 995/2022] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:55:41.461937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475aed04-a598-4da3-bbbe-45bf47e9ce17 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.472316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475aed04-a598-4da3-bbbe-45bf47e9ce17 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.478496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.479168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.479445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.479714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.480444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.482386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.512905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1028/2023] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:41 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:41.517674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.528008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90d40b-d5a4-4d7c-b8a4-9dac83451a0a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.594175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.594826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.595107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.595381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.596097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.598045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.621319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 996/2024] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:41 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:41.625670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.636032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9d96c-1eda-4a59-b328-709353c2c05b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.641021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.641680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.641962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.642235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.642950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.644595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.654836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1029/2025] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:41.659498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.675361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9ba7-6ef6-41d1-a1db-ec7a73fca07a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.684035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddc050-8e83-4e97-95c2-a1ee24d0ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.685069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc050-8e83-4e97-95c2-a1ee24d0ee77 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.685449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc050-8e83-4e97-95c2-a1ee24d0ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.685738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc050-8e83-4e97-95c2-a1ee24d0ee77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.686469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddc050-8e83-4e97-95c2-a1ee24d0ee77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.688117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddc050-8e83-4e97-95c2-a1ee24d0ee77 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.698094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 997/2026] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:41.702621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.712640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a091a2-643e-4d3d-b070-eb1d46e50cd8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.717569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.718451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.718733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.719009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] PATH_INFO: `/v3/projects/96f1f8287c8c4c0da430dc5daef01813/users/d8b43419aba7485989facb2d0ed8f1aa/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.733819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f1f8287c8c4c0da430dc5daef01813, user_id=d8b43419aba7485989facb2d0ed8f1aa, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.736463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.753740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1030/2027] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:41 2022] PUT /identity/v3/projects/96f1f8287c8c4c0da430dc5daef01813/users/d8b43419aba7485989facb2d0ed8f1aa/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:41.758759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dad1b-25b5-4a4a-95c2-39f9e0bdae01 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.759030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dad1b-25b5-4a4a-95c2-39f9e0bdae01 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.759308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dad1b-25b5-4a4a-95c2-39f9e0bdae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.777698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a76dad1b-25b5-4a4a-95c2-39f9e0bdae01 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:41.779330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a76dad1b-25b5-4a4a-95c2-39f9e0bdae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:41.840351 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 998/2028] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:41.850088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:41.852278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:41.908467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046af44-fba0-4fc6-a1a0-9d354af06ffe admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:41.912601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:41.913282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:41.913565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:41.913841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:41.924022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:41.925459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:41.935518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1031/2029] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:42.625587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:42.626108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:42.626108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:42.653119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] MFA Rules not processed for user `d8b43419aba7485989facb2d0ed8f1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:42.654992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:42.721159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 999/2030] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:42.732708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:42.734153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:42.789005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab211f9-2eee-4b85-b82e-1a00328b3bfd service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:42.792936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:42.793592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:42.793876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:42.794197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:42.802895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:42.804388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:42.813213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1032/2031] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:44.126110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.127816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:44.146960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238e435-6033-4b79-a7dd-24ee276142cf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.152897 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.154011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.154476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.154952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] PATH_INFO: `/v3/users/461f929b4237427791b49ec3cb465091` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.156412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=461f929b4237427791b49ec3cb465091)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:44.158605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:44.214936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461f929b4237427791b49ec3cb465091'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.221711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461f929b4237427791b49ec3cb465091'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.222383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461f929b4237427791b49ec3cb465091'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.235012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461f929b4237427791b49ec3cb465091'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.235681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d8cd341-8042-43f6-a935-6a638bec7a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461f929b4237427791b49ec3cb465091'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.250398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1000/2032] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:44 2022] DELETE /identity/v3/users/461f929b4237427791b49ec3cb465091 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:44.418681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.430552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f28b-4ac8-4ea6-ad88-98b91dc5cafa service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.488790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.489712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.489994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.490270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] PATH_INFO: `/v3/projects/8159266bb76747dc8687d5884241dd29` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.491469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8159266bb76747dc8687d5884241dd29)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:44.493413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:44.539057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8159266bb76747dc8687d5884241dd29', 'request_id': 'req-67e7187e-f917-4f06-9085-a12a18164c08'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.545196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8159266bb76747dc8687d5884241dd29', 'request_id': 'req-67e7187e-f917-4f06-9085-a12a18164c08'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.555491 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8159266bb76747dc8687d5884241dd29', 'request_id': 'req-67e7187e-f917-4f06-9085-a12a18164c08'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.565594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] The token cache is being invalidate because project 8159266bb76747dc8687d5884241dd29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:44.565876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.566514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e7187e-f917-4f06-9085-a12a18164c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:44.568111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1033/2033] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:44 2022] DELETE /identity/v3/projects/8159266bb76747dc8687d5884241dd29 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:44.574129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba9d4-5a2e-46c9-9c56-412b56e33888 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.574416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba9d4-5a2e-46c9-9c56-412b56e33888 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.574693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba9d4-5a2e-46c9-9c56-412b56e33888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.594197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dc5ba9d4-5a2e-46c9-9c56-412b56e33888 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:44.595400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dc5ba9d4-5a2e-46c9-9c56-412b56e33888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:44.656304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1001/2034] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:44.665486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c140e-604d-4d32-a2ef-34b8a4db19e1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.665947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c140e-604d-4d32-a2ef-34b8a4db19e1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.666366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c140e-604d-4d32-a2ef-34b8a4db19e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.691955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e45c140e-604d-4d32-a2ef-34b8a4db19e1 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:44.693186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e45c140e-604d-4d32-a2ef-34b8a4db19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:44.702289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1034/2035] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:44.706676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba9d4-5a2e-46c9-9c56-412b56e33888 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.716729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba9d4-5a2e-46c9-9c56-412b56e33888 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.721623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.722293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.722576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.722878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.723601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:44.723940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:44.725551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:44.737068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1002/2036] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:55:44.741475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c140e-604d-4d32-a2ef-34b8a4db19e1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.751764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c140e-604d-4d32-a2ef-34b8a4db19e1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.756767 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.757406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.757686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.757956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.758650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:44.760593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:44.788617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1035/2037] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:44 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:44.792867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.803022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c07e-9454-469a-b43e-6296528d1fa5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.864586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.865293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.865575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.865847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.866544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:44.868525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:44.892887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1003/2038] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:44 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:44.897189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.907839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16538b6-8eb7-4896-96ed-e88c12edb4d0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.913606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.914313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.914709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.915017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.915800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:44.917516 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:44.929119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1036/2039] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:44.933198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.943585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4a0a1-051d-4413-bb36-6c0180318259 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.948515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4ac0-34a5-4a9e-a694-61dab308cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.949216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4ac0-34a5-4a9e-a694-61dab308cbda admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.949507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4ac0-34a5-4a9e-a694-61dab308cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.949865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4ac0-34a5-4a9e-a694-61dab308cbda admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:44.950791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d4ac0-34a5-4a9e-a694-61dab308cbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:44.953089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d4ac0-34a5-4a9e-a694-61dab308cbda admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:44.964422 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1004/2040] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:44.968830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:44.979716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8739d-84e9-46ce-81c6-aac631d8b5ea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:44.986735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:44.987627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:44.987909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:44.988221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] PATH_INFO: `/v3/projects/ceb30f3009d84ca78b2dca6a23b620e5/users/ea10a990466740cb98d5706656b27652/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:45.004271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb30f3009d84ca78b2dca6a23b620e5, user_id=ea10a990466740cb98d5706656b27652, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:45.006961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:45.022758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1037/2041] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:44 2022] PUT /identity/v3/projects/ceb30f3009d84ca78b2dca6a23b620e5/users/ea10a990466740cb98d5706656b27652/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:45.034585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f66f-5618-4eb2-b40d-3d2f4d199634 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:45.034880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f66f-5618-4eb2-b40d-3d2f4d199634 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:45.035158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f66f-5618-4eb2-b40d-3d2f4d199634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:45.063777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8f15f66f-5618-4eb2-b40d-3d2f4d199634 None None] MFA Rules not processed for user `ea10a990466740cb98d5706656b27652`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:45.065041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8f15f66f-5618-4eb2-b40d-3d2f4d199634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:45.141175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1005/2042] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:45.152492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:45.154681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:45.216770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286b27-4833-46d2-8685-e59afc04e1b4 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:45.221648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:45.222340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:45.222625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:45.222897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:45.233220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:45.234669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:45.243745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1038/2043] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:45.244428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6945b9-004f-452f-8d51-14f236185441 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:45.244713 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6945b9-004f-452f-8d51-14f236185441 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:45.244997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6945b9-004f-452f-8d51-14f236185441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:45.263031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-af6945b9-004f-452f-8d51-14f236185441 None None] MFA Rules not processed for user `d8b43419aba7485989facb2d0ed8f1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:45.264433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af6945b9-004f-452f-8d51-14f236185441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:45.324179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1006/2044] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:52.031047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:52.032550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:52.108292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738bee5-b9e3-4b32-a7b7-f292a9cdd635 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:52.112835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:52.113739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:52.114018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:52.114298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] PATH_INFO: `/v3/users/e3652f6152b14c6c97b6750e0cbd66f1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:52.115500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3652f6152b14c6c97b6750e0cbd66f1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:52.117495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:52.169592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3652f6152b14c6c97b6750e0cbd66f1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.178712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3652f6152b14c6c97b6750e0cbd66f1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.191439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3652f6152b14c6c97b6750e0cbd66f1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.199789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3652f6152b14c6c97b6750e0cbd66f1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.200619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3652f6152b14c6c97b6750e0cbd66f1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.209084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1039/2045] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:52 2022] DELETE /identity/v3/users/e3652f6152b14c6c97b6750e0cbd66f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:52.211800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:52.212299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:52.212515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:52.233553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:52.234872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:52.299903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1007/2046] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:52.309174 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:52.310723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:52.374104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9077-1019-4c31-80fe-301a9f65dc3b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:52.377662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9493-fce0-4433-a4e2-05e667f05783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:52.378555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9493-fce0-4433-a4e2-05e667f05783 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:52.378900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9493-fce0-4433-a4e2-05e667f05783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:52.379241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9493-fce0-4433-a4e2-05e667f05783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:52.389750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9493-fce0-4433-a4e2-05e667f05783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:52.391409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9493-fce0-4433-a4e2-05e667f05783 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:52.402590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1040/2047] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:52.796528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:52.798034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:52.810423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcc642-aeb7-4fac-b691-88619f8dbc2b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:52.815332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:52.816237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:52.816525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:52.816786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] PATH_INFO: `/v3/projects/8ebdf4d2ea804db2960d293c9fec1195` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:52.817994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ebdf4d2ea804db2960d293c9fec1195)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:52.820057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:52.868267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ebdf4d2ea804db2960d293c9fec1195', 'request_id': 'req-a122cdc4-a030-4976-9fd6-b1ac269038f0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.874664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ebdf4d2ea804db2960d293c9fec1195', 'request_id': 'req-a122cdc4-a030-4976-9fd6-b1ac269038f0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.885867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ebdf4d2ea804db2960d293c9fec1195', 'request_id': 'req-a122cdc4-a030-4976-9fd6-b1ac269038f0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.897762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] The token cache is being invalidate because project 8ebdf4d2ea804db2960d293c9fec1195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:52.898074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.898728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a122cdc4-a030-4976-9fd6-b1ac269038f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:52.900355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1008/2048] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:52 2022] DELETE /identity/v3/projects/8ebdf4d2ea804db2960d293c9fec1195 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:52.905330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949f33-a32f-4c90-9434-c3f8b47babab None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:52.906175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949f33-a32f-4c90-9434-c3f8b47babab None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:52.906456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949f33-a32f-4c90-9434-c3f8b47babab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:52.924346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-09949f33-a32f-4c90-9434-c3f8b47babab None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:52.925574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-09949f33-a32f-4c90-9434-c3f8b47babab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:52.988860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1041/2049] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:52.996804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0170-0bae-4b6b-a392-b0e03230800e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:52.997128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0170-0bae-4b6b-a392-b0e03230800e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:52.997406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0170-0bae-4b6b-a392-b0e03230800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.017876 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c3ca0170-0bae-4b6b-a392-b0e03230800e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:53.019128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c3ca0170-0bae-4b6b-a392-b0e03230800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:53.028335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1009/2050] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:53.033011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949f33-a32f-4c90-9434-c3f8b47babab None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:53.043525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949f33-a32f-4c90-9434-c3f8b47babab None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:53.049657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:53.050358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.050636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.050903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.051628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:53.051952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:53.053550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:53.065706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1042/2051] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:55:53.071694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0170-0bae-4b6b-a392-b0e03230800e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:53.081822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0170-0bae-4b6b-a392-b0e03230800e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:53.087024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:53.087762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.088152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.088494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.089269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:53.091278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:53.122900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1010/2052] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:53 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:53.124274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:53.133889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6161e-411e-411f-891f-2e3f0ae7f79b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:53.190599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:53.191281 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.191565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.191842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.192563 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:53.194546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:53.219030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1043/2053] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:53 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:55:53.223235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:53.234474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669c80-3d5d-4ec6-90a0-1f7cbfb642f2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:53.239679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:53.240469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.240817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.241163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.241974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:53.243664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:53.258299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1011/2054] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:53.260360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:53.271091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ec8bb-301d-405f-ba46-36fba78e935f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:53.276072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9eb0e-bceb-43ec-bbec-2135094f5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:53.276811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9eb0e-bceb-43ec-bbec-2135094f5089 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.277144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9eb0e-bceb-43ec-bbec-2135094f5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.277533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9eb0e-bceb-43ec-bbec-2135094f5089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.278332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9eb0e-bceb-43ec-bbec-2135094f5089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:53.280034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9eb0e-bceb-43ec-bbec-2135094f5089 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:53.293812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1044/2055] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:53.295215 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:53.306459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0249-8515-499d-9029-1ed6d6f119c6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:53.311614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:53.312543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.312826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.313103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] PATH_INFO: `/v3/projects/c3daa66b741544fb93c183036ee934ef/users/f833ea81f4e64142b591d464f80e09a0/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.329742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3daa66b741544fb93c183036ee934ef, user_id=f833ea81f4e64142b591d464f80e09a0, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:53.332677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:53.347789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1012/2056] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:53 2022] PUT /identity/v3/projects/c3daa66b741544fb93c183036ee934ef/users/f833ea81f4e64142b591d464f80e09a0/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:53.358144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.358498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.358780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.385405 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] MFA Rules not processed for user `f833ea81f4e64142b591d464f80e09a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:53.386711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:53.453601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1045/2057] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:53.466230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:53.468154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:53.539697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfe0ca-b709-439c-a3fb-69a9d1fa5880 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:53.544155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776045f9-cf39-4542-9ff1-da675020d627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:53.544814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776045f9-cf39-4542-9ff1-da675020d627 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:53.545154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776045f9-cf39-4542-9ff1-da675020d627 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:53.545401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776045f9-cf39-4542-9ff1-da675020d627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:53.555091 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776045f9-cf39-4542-9ff1-da675020d627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:53.556578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776045f9-cf39-4542-9ff1-da675020d627 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:53.565828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1013/2058] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:55.758773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:55.760437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:55.829385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934d09-8479-4d95-84cf-b1ec62e11603 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:55.834923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:55.835892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:55.836173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:55.836451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] PATH_INFO: `/v3/users/ea10a990466740cb98d5706656b27652` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:55.837691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea10a990466740cb98d5706656b27652)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:55.839741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:55.886714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea10a990466740cb98d5706656b27652'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:55.896130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea10a990466740cb98d5706656b27652'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:55.908995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea10a990466740cb98d5706656b27652'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:55.915629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea10a990466740cb98d5706656b27652'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:55.916341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea10a990466740cb98d5706656b27652'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:55.922270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1046/2059] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:55 2022] DELETE /identity/v3/users/ea10a990466740cb98d5706656b27652 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:55.927147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:55.927633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:55.927723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:55.944941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:55.946140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.011084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1014/2060] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:56.022684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.024468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.083108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ecc51-006f-47fc-b7ea-2501b447cf1b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.087081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd266b5-e5ad-4380-9461-741a594b2826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.087728 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd266b5-e5ad-4380-9461-741a594b2826 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.088038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd266b5-e5ad-4380-9461-741a594b2826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.088312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd266b5-e5ad-4380-9461-741a594b2826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.097731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd266b5-e5ad-4380-9461-741a594b2826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.099175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd266b5-e5ad-4380-9461-741a594b2826 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.109109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1047/2061] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:56.386890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.388505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.403989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b695ca-a80c-42ad-a3c0-a9658e4edc92 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.411169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.412084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.412363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.412718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] PATH_INFO: `/v3/projects/ceb30f3009d84ca78b2dca6a23b620e5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.413963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb30f3009d84ca78b2dca6a23b620e5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.416011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.464377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb30f3009d84ca78b2dca6a23b620e5', 'request_id': 'req-c0aca39f-0640-497f-9d49-374cd16c767f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.470691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb30f3009d84ca78b2dca6a23b620e5', 'request_id': 'req-c0aca39f-0640-497f-9d49-374cd16c767f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.479908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb30f3009d84ca78b2dca6a23b620e5', 'request_id': 'req-c0aca39f-0640-497f-9d49-374cd16c767f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.490368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] The token cache is being invalidate because project ceb30f3009d84ca78b2dca6a23b620e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:56.490654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.491312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c0aca39f-0640-497f-9d49-374cd16c767f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.492936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1015/2062] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:56 2022] DELETE /identity/v3/projects/ceb30f3009d84ca78b2dca6a23b620e5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:56.498075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9fca9-409f-4a7c-b7ec-d33e0b3ae551 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.498372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9fca9-409f-4a7c-b7ec-d33e0b3ae551 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.498672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9fca9-409f-4a7c-b7ec-d33e0b3ae551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.517298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-65b9fca9-409f-4a7c-b7ec-d33e0b3ae551 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:56.518545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-65b9fca9-409f-4a7c-b7ec-d33e0b3ae551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.584237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1048/2063] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:55:56.592152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.592427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.592994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.611559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:56.612778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.621515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1016/2064] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:56.625997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9fca9-409f-4a7c-b7ec-d33e0b3ae551 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.636777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9fca9-409f-4a7c-b7ec-d33e0b3ae551 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.644152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.644828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.645113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.645390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.646136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:56.646447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.648437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.654713 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.656654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.663321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1049/2065] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:55:56.667607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.673381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1528-6a2b-47fe-a0f7-902421dbd232 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.680235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766910f-e87d-498e-bf34-cbf391ba17e7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.680756 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.681804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.682258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.682697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] PATH_INFO: `/v3/users/f833ea81f4e64142b591d464f80e09a0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.684344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f833ea81f4e64142b591d464f80e09a0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.686597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.687034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.687983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.688271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.688554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.689260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.691235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.728011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1050/2066] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:56 2022] POST /identity/v3/projects => generated 403 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:56.733827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.754085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f833ea81f4e64142b591d464f80e09a0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.760638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f833ea81f4e64142b591d464f80e09a0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.761312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f833ea81f4e64142b591d464f80e09a0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.772534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f833ea81f4e64142b591d464f80e09a0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.773231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-86ec168c-774d-4dd9-b237-f35ee979745b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f833ea81f4e64142b591d464f80e09a0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:56.787637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1017/2067] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:55:56 2022] DELETE /identity/v3/users/f833ea81f4e64142b591d464f80e09a0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:56.792142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.792437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.792789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.799904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1022b-c5a9-4fea-b7ed-34cb67b8b07a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.810496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:56.811851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.856929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.857596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.857877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.858153 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.859013 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.861049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.875314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1018/2068] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:55:56.885879 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1051/2069] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:56 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:56.891426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.892770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.894220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.894420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:56.908814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da4fe-eac8-4e7e-b3e3-9e80fc3a2996 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.914205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.914880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.915166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.915433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.916207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.917810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.928058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1052/2070] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:56.932248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.941705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f178372-51fb-4d06-b7db-f3ee16ed55a9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.946380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.947038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.947321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.947595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.948382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.950334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.952933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaf60e-1b74-46d9-a776-0ef34fb7ab7d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.957173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaa03d-b594-4c99-a2d4-0ba459692da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.957975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa03d-b594-4c99-a2d4-0ba459692da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.958258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa03d-b594-4c99-a2d4-0ba459692da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.958526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa03d-b594-4c99-a2d4-0ba459692da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.963025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1053/2071] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:56.967305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:56.969923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaa03d-b594-4c99-a2d4-0ba459692da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:56.971806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaa03d-b594-4c99-a2d4-0ba459692da9 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:56.977177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c277b-9114-4beb-969f-f11b029c4208 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:56.982258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:56.983077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:56.983433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1019/2072] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:56.983561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:56.983738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] PATH_INFO: `/v3/projects/3124e334ab374067ad74af9ca94d327f/users/67622822501240edb4ab84d41b197ac6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:56.998964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3124e334ab374067ad74af9ca94d327f, user_id=67622822501240edb4ab84d41b197ac6, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.001695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.017392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1054/2073] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:56 2022] PUT /identity/v3/projects/3124e334ab374067ad74af9ca94d327f/users/67622822501240edb4ab84d41b197ac6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:57.022886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.023231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.023572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.045359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:57.047310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:57.114940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1020/2074] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:57.126464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.129060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:57.191973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b3e83-aa5d-400a-b02b-cec308c8d337 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.196060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b5f0-d979-4157-9d46-80a00f3650b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.196721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b5f0-d979-4157-9d46-80a00f3650b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.197000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b5f0-d979-4157-9d46-80a00f3650b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.197247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b5f0-d979-4157-9d46-80a00f3650b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.208312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b5f0-d979-4157-9d46-80a00f3650b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.210018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b5f0-d979-4157-9d46-80a00f3650b4 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.222828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1055/2075] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:57.298777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.300672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:57.316218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f85a5-b42e-4849-a42d-aa3ca071532d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.325044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.326465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.326913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.327416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] PATH_INFO: `/v3/projects/c3daa66b741544fb93c183036ee934ef` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.329356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3daa66b741544fb93c183036ee934ef)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.332790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.398235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3daa66b741544fb93c183036ee934ef', 'request_id': 'req-38efe81a-c48f-466e-b3fb-771efb93e7e0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:57.405045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3daa66b741544fb93c183036ee934ef', 'request_id': 'req-38efe81a-c48f-466e-b3fb-771efb93e7e0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:57.414011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3daa66b741544fb93c183036ee934ef', 'request_id': 'req-38efe81a-c48f-466e-b3fb-771efb93e7e0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:57.424541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] The token cache is being invalidate because project c3daa66b741544fb93c183036ee934ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:55:57.424926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:57.425685 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-38efe81a-c48f-466e-b3fb-771efb93e7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:55:57.427428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1021/2076] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:55:57 2022] DELETE /identity/v3/projects/c3daa66b741544fb93c183036ee934ef => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:57.432545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242060-8a62-4b29-ae33-db695b0ace1c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.432847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242060-8a62-4b29-ae33-db695b0ace1c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.433129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242060-8a62-4b29-ae33-db695b0ace1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.453186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-54242060-8a62-4b29-ae33-db695b0ace1c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:57.454442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-54242060-8a62-4b29-ae33-db695b0ace1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:57.524064 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1056/2077] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:57.531740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b34c6-b9b0-4854-87e2-3f990eb2f8ec None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.532856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b34c6-b9b0-4854-87e2-3f990eb2f8ec None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.533242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b34c6-b9b0-4854-87e2-3f990eb2f8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.553764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-255b34c6-b9b0-4854-87e2-3f990eb2f8ec None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:57.555231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-255b34c6-b9b0-4854-87e2-3f990eb2f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:57.564653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1022/2078] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:57.568794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242060-8a62-4b29-ae33-db695b0ace1c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.578434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242060-8a62-4b29-ae33-db695b0ace1c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.583074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.583789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.584104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.584373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.585157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:55:57.585458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.587049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.598736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1057/2079] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:55:57.603281 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b34c6-b9b0-4854-87e2-3f990eb2f8ec None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.613226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b34c6-b9b0-4854-87e2-3f990eb2f8ec None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.618409 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.619073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.619335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.619606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.620339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.622249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.659905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1023/2080] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:57 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:57.661646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.671578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a890f-b7b4-404c-ab5c-4db28df1c82e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.734227 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.734977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.735318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.735657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.736454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.739044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.761611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1058/2081] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:57 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:57.765914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.776716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c5c26-cf19-4255-81ac-d4c01d3812ab admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.781371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.782081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.782433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.782681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.783940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.785041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.799226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1024/2082] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:57.801369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.812009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d5b8-05db-45ee-b87e-acf3db9e6d04 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.816986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bff6e6-e1e8-413f-a6d8-cc2b6ed610f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.817755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bff6e6-e1e8-413f-a6d8-cc2b6ed610f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.818068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bff6e6-e1e8-413f-a6d8-cc2b6ed610f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.818910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bff6e6-e1e8-413f-a6d8-cc2b6ed610f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.819185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bff6e6-e1e8-413f-a6d8-cc2b6ed610f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.820887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bff6e6-e1e8-413f-a6d8-cc2b6ed610f6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.835750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1059/2083] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:55:57.837194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:57.847152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49716f-0bde-4f4a-8698-6ff78184ffba admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:57.852824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:57.853832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.854169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.854501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] PATH_INFO: `/v3/projects/dcf440ca052f440d8798cd578d35c345/users/d36bb5e5a3ba4c3bbc90714040f2ba60/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.870542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf440ca052f440d8798cd578d35c345, user_id=d36bb5e5a3ba4c3bbc90714040f2ba60, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:57.873278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:57.888074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1025/2084] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:57 2022] PUT /identity/v3/projects/dcf440ca052f440d8798cd578d35c345/users/d36bb5e5a3ba4c3bbc90714040f2ba60/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:55:57.900528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a28b2-8aed-4558-bd4a-cf2443814d5e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:57.900927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a28b2-8aed-4558-bd4a-cf2443814d5e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:57.901287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a28b2-8aed-4558-bd4a-cf2443814d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:57.928908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4e5a28b2-8aed-4558-bd4a-cf2443814d5e None None] MFA Rules not processed for user `d36bb5e5a3ba4c3bbc90714040f2ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:57.930089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4e5a28b2-8aed-4558-bd4a-cf2443814d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:58.000853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1060/2085] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:58.012495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:58.014398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:58.104176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6553d66-4a4c-4389-ae19-a410b2bfaa67 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:58.108036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:58.108879 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.109395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.109746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.120449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:58.121982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:58.129151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1a72-4163-42de-9cd9-1bc7fbdd864b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.129561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1a72-4163-42de-9cd9-1bc7fbdd864b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.129858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1a72-4163-42de-9cd9-1bc7fbdd864b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.136060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1026/2086] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:55:58.170670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-514a1a72-4163-42de-9cd9-1bc7fbdd864b None None] MFA Rules not processed for user `67622822501240edb4ab84d41b197ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:58.172189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-514a1a72-4163-42de-9cd9-1bc7fbdd864b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:58.254863 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1061/2087] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:55:58.255080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:58.255718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:58.347287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58a21f-1244-467b-aac8-b0b6b2109878 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:58.351737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:58.352823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.353105 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.353377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.354069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:58.356274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:58.387471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1027/2088] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:55:58 2022] POST /identity/v3/projects => generated 403 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:58.388675 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a1a72-4163-42de-9cd9-1bc7fbdd864b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:58.400948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a1a72-4163-42de-9cd9-1bc7fbdd864b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:58.469945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:58.470845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.471083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.471362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.472134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:58.474240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:58.499954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1062/2089] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:55:58 2022] POST /identity/v3/users => generated 308 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:58.502182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:58.512679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c639bb-1b4b-4e31-b0e8-de8b676463eb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:58.518644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:58.519350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.520880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.521165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.526054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:58.527699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:58.540974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1028/2090] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:58.545286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:58.555730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb2f0e-3577-4bce-b38c-819b8cc0ed24 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:58.560355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:58.561244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.561576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.562054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] PATH_INFO: `/v3/projects/5819d59535254010ba4abd5ba620c180/users/76659307f31a4e8db37c2c1e1e9a1289/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.577295 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5819d59535254010ba4abd5ba620c180, user_id=76659307f31a4e8db37c2c1e1e9a1289, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:58.580249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:58.594370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1063/2091] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:58 2022] PUT /identity/v3/projects/5819d59535254010ba4abd5ba620c180/users/76659307f31a4e8db37c2c1e1e9a1289/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:58.598537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:58.609340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aff91-6059-489e-aea2-f63c6ce1e00a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:58.666504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25366eda-ef1c-43f0-bf9d-86b274c00668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:58.667269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25366eda-ef1c-43f0-bf9d-86b274c00668 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.667561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25366eda-ef1c-43f0-bf9d-86b274c00668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.667840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25366eda-ef1c-43f0-bf9d-86b274c00668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.668658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25366eda-ef1c-43f0-bf9d-86b274c00668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:58.670468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25366eda-ef1c-43f0-bf9d-86b274c00668 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:58.680917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1029/2092] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:55:58.685547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:58.697581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2315918-fc90-4b94-a035-3b6d8c43c7da admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:55:58.704913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:55:58.705506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:58.705849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:58.706192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] PATH_INFO: `/v3/projects/5819d59535254010ba4abd5ba620c180/users/76659307f31a4e8db37c2c1e1e9a1289/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:58.711196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5819d59535254010ba4abd5ba620c180, user_id=76659307f31a4e8db37c2c1e1e9a1289, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:55:58.714043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:55:58.730299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1064/2093] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:55:58 2022] PUT /identity/v3/projects/5819d59535254010ba4abd5ba620c180/users/76659307f31a4e8db37c2c1e1e9a1289/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:55:59.540000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a6bf4-f725-4936-93d5-a50dfac4889a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:59.540532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a6bf4-f725-4936-93d5-a50dfac4889a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:59.540632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a6bf4-f725-4936-93d5-a50dfac4889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:59.569940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1d2a6bf4-f725-4936-93d5-a50dfac4889a None None] MFA Rules not processed for user `76659307f31a4e8db37c2c1e1e9a1289`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:59.571239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1d2a6bf4-f725-4936-93d5-a50dfac4889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:59.649291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1030/2094] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:00.755145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:00.820801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c795924-8612-46ad-ba1c-3e4a9a619acc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:00.825768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:00.826628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:00.826927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:00.827202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] PATH_INFO: `/v3/users/d36bb5e5a3ba4c3bbc90714040f2ba60` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:00.828742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36bb5e5a3ba4c3bbc90714040f2ba60)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:00.830726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:00.879724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36bb5e5a3ba4c3bbc90714040f2ba60'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:00.888386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36bb5e5a3ba4c3bbc90714040f2ba60'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:00.901729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36bb5e5a3ba4c3bbc90714040f2ba60'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:00.908921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36bb5e5a3ba4c3bbc90714040f2ba60'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:00.909647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36bb5e5a3ba4c3bbc90714040f2ba60'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:00.915540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1065/2095] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:56:00 2022] DELETE /identity/v3/users/d36bb5e5a3ba4c3bbc90714040f2ba60 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:00.920157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:00.920627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:00.920977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:00.939618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:00.940982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.003952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1031/2096] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:01.013941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:01.015430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.073416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07a47-6f1f-4bd9-9995-6aaa72e21066 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:01.078245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:01.079105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.079379 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.079671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.089916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:01.091599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:01.093206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:01.095359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.103585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1066/2097] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:01.111553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22e13f-8464-40d6-8995-4e31250db991 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:01.116728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:01.117907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.118453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.118875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] PATH_INFO: `/v3/users/67622822501240edb4ab84d41b197ac6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.120306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67622822501240edb4ab84d41b197ac6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:01.123247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:01.181031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67622822501240edb4ab84d41b197ac6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.193462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67622822501240edb4ab84d41b197ac6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.194217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67622822501240edb4ab84d41b197ac6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.207011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67622822501240edb4ab84d41b197ac6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.208129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67622822501240edb4ab84d41b197ac6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.225040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1032/2098] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:56:01 2022] DELETE /identity/v3/users/67622822501240edb4ab84d41b197ac6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:56:01.528789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:01.530595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.561611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1c239-417d-419a-83d5-ff2f37787192 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:01.622675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:01.625129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.640727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:01.641670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.641941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.642306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] PATH_INFO: `/v3/projects/dcf440ca052f440d8798cd578d35c345` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.643526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf440ca052f440d8798cd578d35c345)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:01.645498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:01.697335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf440ca052f440d8798cd578d35c345', 'request_id': 'req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.703888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf440ca052f440d8798cd578d35c345', 'request_id': 'req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.712089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf440ca052f440d8798cd578d35c345', 'request_id': 'req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.712537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8cfc-3354-4a81-b85d-d59f9928bcd8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:01.722869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] The token cache is being invalidate because project dcf440ca052f440d8798cd578d35c345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:56:01.723161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.723786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-68dc1ecf-7e9f-4e37-9d03-82d91ed777af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.725361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1067/2099] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:56:01 2022] DELETE /identity/v3/projects/dcf440ca052f440d8798cd578d35c345 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:01.730334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca059f-f28f-4fb9-8590-dabef130b743 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.730561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca059f-f28f-4fb9-8590-dabef130b743 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.730839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca059f-f28f-4fb9-8590-dabef130b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.757723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cdca059f-f28f-4fb9-8590-dabef130b743 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:01.758919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cdca059f-f28f-4fb9-8590-dabef130b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.770287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:01.771289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.771570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.771848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] PATH_INFO: `/v3/projects/3124e334ab374067ad74af9ca94d327f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.773266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3124e334ab374067ad74af9ca94d327f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:01.775276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:01.819722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1068/2100] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:01.823927 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3124e334ab374067ad74af9ca94d327f', 'request_id': 'req-123f0a55-4a8d-4ada-8c23-99a3891bdb45'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.827428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c1d74-ce53-4f60-8a5d-d35654eb6011 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.827751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c1d74-ce53-4f60-8a5d-d35654eb6011 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.828061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c1d74-ce53-4f60-8a5d-d35654eb6011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.830540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3124e334ab374067ad74af9ca94d327f', 'request_id': 'req-123f0a55-4a8d-4ada-8c23-99a3891bdb45'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.839309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3124e334ab374067ad74af9ca94d327f', 'request_id': 'req-123f0a55-4a8d-4ada-8c23-99a3891bdb45'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.861639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] The token cache is being invalidate because project 3124e334ab374067ad74af9ca94d327f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:56:01.861926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.862638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:01.864482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1033/2101] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:56:01 2022] DELETE /identity/v3/projects/3124e334ab374067ad74af9ca94d327f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:01.868157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:01.869509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.886427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c24c1d74-ce53-4f60-8a5d-d35654eb6011 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:01.887646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c24c1d74-ce53-4f60-8a5d-d35654eb6011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:01.973267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0a55-4a8d-4ada-8c23-99a3891bdb45 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:01.975709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1069/2102] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:01.978312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:01.979373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.979481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.979731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] PATH_INFO: `/v3/users/76659307f31a4e8db37c2c1e1e9a1289` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.980272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c1d74-ce53-4f60-8a5d-d35654eb6011 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:01.981254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76659307f31a4e8db37c2c1e1e9a1289)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:01.983151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:01.989839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c1d74-ce53-4f60-8a5d-d35654eb6011 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:01.996522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:01.997196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:01.997482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:01.997759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:01.998527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:56:01.998856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.000570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.012944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1070/2103] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:56:02.017993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.027696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e35326-f2e6-459f-bfd7-4e906d02f589 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.032538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.033191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.033472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.033746 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.035477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.035662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76659307f31a4e8db37c2c1e1e9a1289'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.038024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.042777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76659307f31a4e8db37c2c1e1e9a1289'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.043496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76659307f31a4e8db37c2c1e1e9a1289'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.055545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76659307f31a4e8db37c2c1e1e9a1289'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.056386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76659307f31a4e8db37c2c1e1e9a1289'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.070193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1071/2104] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:56:02.072163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1034/2105] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:56:01 2022] DELETE /identity/v3/users/76659307f31a4e8db37c2c1e1e9a1289 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:56:02.076694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.078463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:02.147445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ff682-efc0-4ae5-8980-493efcde0586 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.210678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.211363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.211647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.212004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.212702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.214662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.238075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1072/2106] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:56:02.241870 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.252392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a083-8cae-4c3e-b6e2-bbc769e8cac0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.257087 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.257423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.257963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.258242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.258515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.259259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.259375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:02.261013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.271476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1035/2107] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:56:02.273852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a0e6-5857-4691-8743-5acce4f1f2c6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.275436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.283653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.284622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.284909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.285184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] PATH_INFO: `/v3/projects/5819d59535254010ba4abd5ba620c180` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.286392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5819d59535254010ba4abd5ba620c180)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.288102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a5111-4536-4642-bbaa-2e6319a04667 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.288526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.293672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.294417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.294769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.295123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.295955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.298516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.308939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1036/2108] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:56:02.313102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.323572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822246f-348a-485b-b3cb-1edc64967c89 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.335425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5819d59535254010ba4abd5ba620c180', 'request_id': 'req-cc016409-21d0-49bf-aa19-f8b64ba5cb54'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.342500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5819d59535254010ba4abd5ba620c180', 'request_id': 'req-cc016409-21d0-49bf-aa19-f8b64ba5cb54'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.351148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5819d59535254010ba4abd5ba620c180', 'request_id': 'req-cc016409-21d0-49bf-aa19-f8b64ba5cb54'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.361601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] The token cache is being invalidate because project 5819d59535254010ba4abd5ba620c180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:56:02.361889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.362551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cc016409-21d0-49bf-aa19-f8b64ba5cb54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:02.364154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1073/2109] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:56:02 2022] DELETE /identity/v3/projects/5819d59535254010ba4abd5ba620c180 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:56:02.369087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e7e72-f7f0-48d3-b237-591a799b422d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.369366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e7e72-f7f0-48d3-b237-591a799b422d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.369641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e7e72-f7f0-48d3-b237-591a799b422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.383047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b66fc-67da-442f-8400-b50caf0d72fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.383930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b66fc-67da-442f-8400-b50caf0d72fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.384211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b66fc-67da-442f-8400-b50caf0d72fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.384491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b66fc-67da-442f-8400-b50caf0d72fa admin admin] PATH_INFO: `/v3/projects/dc51e5baf89d405ea94dc6a2c60960aa/users/a76fec6eddf4455b9ec6bc95295976fa/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.387517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bd3e7e72-f7f0-48d3-b237-591a799b422d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:02.388745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bd3e7e72-f7f0-48d3-b237-591a799b422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:02.396847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1074/2110] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:02.398311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b66fc-67da-442f-8400-b50caf0d72fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc51e5baf89d405ea94dc6a2c60960aa, user_id=a76fec6eddf4455b9ec6bc95295976fa, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.401003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b66fc-67da-442f-8400-b50caf0d72fa admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.404400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304724-2e96-4693-96f7-c32c9e80ca43 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.404882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304724-2e96-4693-96f7-c32c9e80ca43 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.405184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304724-2e96-4693-96f7-c32c9e80ca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.415027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1037/2111] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:56:02 2022] PUT /identity/v3/projects/dc51e5baf89d405ea94dc6a2c60960aa/users/a76fec6eddf4455b9ec6bc95295976fa/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:56:02.423812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e3304724-2e96-4693-96f7-c32c9e80ca43 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:02.425069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e3304724-2e96-4693-96f7-c32c9e80ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:02.425207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.425500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.425774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.450616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] MFA Rules not processed for user `a76fec6eddf4455b9ec6bc95295976fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:02.451810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:02.485424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1075/2112] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:02.489422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304724-2e96-4693-96f7-c32c9e80ca43 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.497767 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304724-2e96-4693-96f7-c32c9e80ca43 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.502518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.503165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.503444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.503717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.504480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:56:02.504782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.506401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.519773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1076/2113] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:56:02.524135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.531643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1038/2114] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:02.534170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff3493-7a45-4806-b6c4-e629e3f99a0b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.538876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.539525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.539802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.540104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.540623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.540781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.541970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:02.542666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.570793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1077/2115] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:56:02.574852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.623509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fe77-966c-4300-a48c-79b852a127a7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.651835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025966-be78-49bc-a2b0-5f9c578e7561 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.657061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6c376-8ac0-4f52-ad8a-644739eee2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.657725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c376-8ac0-4f52-ad8a-644739eee2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.658143 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c376-8ac0-4f52-ad8a-644739eee2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.658421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c376-8ac0-4f52-ad8a-644739eee2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.660037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6c376-8ac0-4f52-ad8a-644739eee2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.661328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6c376-8ac0-4f52-ad8a-644739eee2a8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.680982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.681744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.682031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.682310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.689166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1078/2116] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:56:02.690721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a176-65f5-408e-a474-8590585c2636 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.691016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a176-65f5-408e-a474-8590585c2636 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.691290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a176-65f5-408e-a474-8590585c2636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.708697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b0a0a176-65f5-408e-a474-8590585c2636 None None] MFA Rules not processed for user `d8b43419aba7485989facb2d0ed8f1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:02.709881 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b0a0a176-65f5-408e-a474-8590585c2636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:02.741255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.743301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.752887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1039/2117] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:56:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:02.753679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.765621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715e054-ae64-4e65-baaf-7177d52a7bbd service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.772712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.773029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1079/2118] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:02.773595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.773884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.774160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.774929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.776969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.789429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1040/2119] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:56:02.797266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0a176-65f5-408e-a474-8590585c2636 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.807936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0a176-65f5-408e-a474-8590585c2636 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.813108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4741f54-f805-4218-a45a-c7489b81ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.813245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4741f54-f805-4218-a45a-c7489b81ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.813483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4741f54-f805-4218-a45a-c7489b81ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.813751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4741f54-f805-4218-a45a-c7489b81ed2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.814475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4741f54-f805-4218-a45a-c7489b81ed2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.816092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4741f54-f805-4218-a45a-c7489b81ed2c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.826251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1080/2120] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:56:02.830636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:02.841454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e7ee5-f2d6-487b-a13e-541823a4ea7e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:02.846367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43342383-a765-4691-b782-0522fbced492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:02.847318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342383-a765-4691-b782-0522fbced492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.847708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342383-a765-4691-b782-0522fbced492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.848073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342383-a765-4691-b782-0522fbced492 admin admin] PATH_INFO: `/v3/projects/a92cf66e949244879a4f1e71d3871654/users/6ddc8988a9fe4dbdbb9c4fec34cb92d6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.864680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43342383-a765-4691-b782-0522fbced492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92cf66e949244879a4f1e71d3871654, user_id=6ddc8988a9fe4dbdbb9c4fec34cb92d6, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:02.867389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43342383-a765-4691-b782-0522fbced492 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:02.891077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1041/2121] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:56:02 2022] PUT /identity/v3/projects/a92cf66e949244879a4f1e71d3871654/users/6ddc8988a9fe4dbdbb9c4fec34cb92d6/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:02.893295 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015b44-476f-41a1-a9da-1a1c4b4f3854 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:02.893694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015b44-476f-41a1-a9da-1a1c4b4f3854 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:02.894044 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015b44-476f-41a1-a9da-1a1c4b4f3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:02.924826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-af015b44-476f-41a1-a9da-1a1c4b4f3854 None None] MFA Rules not processed for user `6ddc8988a9fe4dbdbb9c4fec34cb92d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:02.926095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-af015b44-476f-41a1-a9da-1a1c4b4f3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:03.000502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1081/2122] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:03.005298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43342383-a765-4691-b782-0522fbced492 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.082489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43342383-a765-4691-b782-0522fbced492 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.087804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.091479 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.091806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.092115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.093361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.095494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.126870 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1042/2123] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:56:03 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:56:03.130771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af015b44-476f-41a1-a9da-1a1c4b4f3854 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.146194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af015b44-476f-41a1-a9da-1a1c4b4f3854 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.204391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.205151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.205526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.205900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.206678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.208863 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.233648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1082/2124] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:56:03 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:56:03.235199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.245575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ae14c-e98f-4ec4-b2ca-2b94d64934b1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.250663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.251463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.251749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.252064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.252794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.254586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.265718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1043/2125] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:56:03.270220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.280216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d49e6-27a3-4437-bb6b-c5c68593ac0d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.285205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.286095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.286375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.286680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] PATH_INFO: `/v3/projects/d09a5ce789a04431bbf1c96711aa12f1/users/14a212d395f848c8be3f3e42ec6ea431/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.302761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09a5ce789a04431bbf1c96711aa12f1, user_id=14a212d395f848c8be3f3e42ec6ea431, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.306218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.321935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1083/2126] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:56:03 2022] PUT /identity/v3/projects/d09a5ce789a04431bbf1c96711aa12f1/users/14a212d395f848c8be3f3e42ec6ea431/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:03.326016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.340052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d58a8-cb2b-48b7-8ce5-9612272e3072 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.402979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289058b9-c244-4d47-9a6d-3ecd72b1b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.404429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289058b9-c244-4d47-9a6d-3ecd72b1b4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.404429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289058b9-c244-4d47-9a6d-3ecd72b1b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.404429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289058b9-c244-4d47-9a6d-3ecd72b1b4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.405241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289058b9-c244-4d47-9a6d-3ecd72b1b4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.407161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289058b9-c244-4d47-9a6d-3ecd72b1b4bc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.422651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1044/2127] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:56:03.423834 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.433917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca274b-3a03-4553-820a-06a9755f9a96 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.438570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.439491 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.439775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.440084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] PATH_INFO: `/v3/projects/d09a5ce789a04431bbf1c96711aa12f1/users/14a212d395f848c8be3f3e42ec6ea431/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.442035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09a5ce789a04431bbf1c96711aa12f1, user_id=14a212d395f848c8be3f3e42ec6ea431, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.444735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.455977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1084/2128] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:56:03 2022] PUT /identity/v3/projects/d09a5ce789a04431bbf1c96711aa12f1/users/14a212d395f848c8be3f3e42ec6ea431/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:56:03.467359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c39c9-64eb-468e-9a7a-b2d69a15ca6b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.467727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c39c9-64eb-468e-9a7a-b2d69a15ca6b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.468065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c39c9-64eb-468e-9a7a-b2d69a15ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.494810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6a7c39c9-64eb-468e-9a7a-b2d69a15ca6b None None] MFA Rules not processed for user `14a212d395f848c8be3f3e42ec6ea431`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:03.496114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6a7c39c9-64eb-468e-9a7a-b2d69a15ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:03.565408 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1045/2129] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:03.577040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.578862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:03.636924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa1e90-246c-4f7c-b72f-5db210efc04f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.641752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.642417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.642704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.642984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.653818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.655414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.665442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1085/2130] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:03.744277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c39c9-64eb-468e-9a7a-b2d69a15ca6b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:03.755432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c39c9-64eb-468e-9a7a-b2d69a15ca6b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:03.760071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717f5b4-9735-4739-856d-97a35dfdd725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:03.760730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717f5b4-9735-4739-856d-97a35dfdd725 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:03.761014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717f5b4-9735-4739-856d-97a35dfdd725 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:03.761295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717f5b4-9735-4739-856d-97a35dfdd725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:03.823063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717f5b4-9735-4739-856d-97a35dfdd725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:03.824630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717f5b4-9735-4739-856d-97a35dfdd725 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:03.833934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1046/2131] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:14.823359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:14.825445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:14.900195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0bae-613f-42a5-97d3-234f00ce19d7 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:14.906024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:14.907329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:14.907621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:14.907917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] PATH_INFO: `/v3/users/a76fec6eddf4455b9ec6bc95295976fa` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:14.909201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76fec6eddf4455b9ec6bc95295976fa)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:14.911139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:14.963788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76fec6eddf4455b9ec6bc95295976fa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:14.972477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76fec6eddf4455b9ec6bc95295976fa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:14.984622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76fec6eddf4455b9ec6bc95295976fa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:14.991897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76fec6eddf4455b9ec6bc95295976fa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:14.992674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76fec6eddf4455b9ec6bc95295976fa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:14.999060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1086/2132] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:56:14 2022] DELETE /identity/v3/users/a76fec6eddf4455b9ec6bc95295976fa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:15.003824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:15.004357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:15.004447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:15.022024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:15.023392 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:15.090117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1047/2133] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:15.100707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:15.102558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:15.182311 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d5ead-aa8a-4e95-b033-7a1e777877e5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:15.185999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d371979-d263-40e5-a23f-eb3b6d3aceaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:15.186650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371979-d263-40e5-a23f-eb3b6d3aceaa service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:15.186944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371979-d263-40e5-a23f-eb3b6d3aceaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:15.187218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371979-d263-40e5-a23f-eb3b6d3aceaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:15.196117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d371979-d263-40e5-a23f-eb3b6d3aceaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:15.197551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d371979-d263-40e5-a23f-eb3b6d3aceaa service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:15.206723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1087/2134] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:15.564266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:15.566519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:15.586157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea230d-e92f-42e0-ab1b-f7c49c891a91 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:15.593579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:15.594689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:15.594981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:15.595256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] PATH_INFO: `/v3/projects/dc51e5baf89d405ea94dc6a2c60960aa` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:15.596554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc51e5baf89d405ea94dc6a2c60960aa)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:15.598561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:15.655054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc51e5baf89d405ea94dc6a2c60960aa', 'request_id': 'req-b05889e3-36f7-420f-900b-e481012a7271'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:15.662214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc51e5baf89d405ea94dc6a2c60960aa', 'request_id': 'req-b05889e3-36f7-420f-900b-e481012a7271'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:15.671328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc51e5baf89d405ea94dc6a2c60960aa', 'request_id': 'req-b05889e3-36f7-420f-900b-e481012a7271'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:15.683527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] The token cache is being invalidate because project dc51e5baf89d405ea94dc6a2c60960aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:56:15.683974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:15.684723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:15.686708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1048/2135] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:56:15 2022] DELETE /identity/v3/projects/dc51e5baf89d405ea94dc6a2c60960aa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:42.387852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:42.388418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:42.388418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:42.418155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:42.419357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:42.485591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1088/2136] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:42.531470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:42.533227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:42.610032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05889e3-36f7-420f-900b-e481012a7271 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:42.616122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c53768-c984-446d-bfe8-44e9be9860bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:42.616817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53768-c984-446d-bfe8-44e9be9860bd service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:42.617102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53768-c984-446d-bfe8-44e9be9860bd service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:42.617381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53768-c984-446d-bfe8-44e9be9860bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:42.627010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c53768-c984-446d-bfe8-44e9be9860bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:42.628676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c53768-c984-446d-bfe8-44e9be9860bd service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:42.637206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1049/2137] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 14:56:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:56:58.901001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:58.903387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:58.985414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d72cf7-d5e5-4dee-8431-07202be96871 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:58.992529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:58.993997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:58.994505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:58.994983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] PATH_INFO: `/v3/users/6ddc8988a9fe4dbdbb9c4fec34cb92d6` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:58.997159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddc8988a9fe4dbdbb9c4fec34cb92d6)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:59.000671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:59.052904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddc8988a9fe4dbdbb9c4fec34cb92d6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.063686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddc8988a9fe4dbdbb9c4fec34cb92d6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.077301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddc8988a9fe4dbdbb9c4fec34cb92d6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.084737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddc8988a9fe4dbdbb9c4fec34cb92d6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.085549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddc8988a9fe4dbdbb9c4fec34cb92d6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.092583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1089/2138] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:56:58 2022] DELETE /identity/v3/users/6ddc8988a9fe4dbdbb9c4fec34cb92d6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:59.097060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd57d10-bde5-4705-b6d9-bc13ce38454e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:59.097591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd57d10-bde5-4705-b6d9-bc13ce38454e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:59.097748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd57d10-bde5-4705-b6d9-bc13ce38454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:59.120545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9fd57d10-bde5-4705-b6d9-bc13ce38454e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:59.122715 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9fd57d10-bde5-4705-b6d9-bc13ce38454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:59.187668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1050/2139] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:59.197559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:59.199100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:59.258535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e92c36-2870-4c48-b575-ce77e3e6a2f4 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:59.263484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:59.264192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:59.264481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:59.264763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:59.275305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:59.277006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:59.287673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1090/2140] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:59.345345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:59.345644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:59.346018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:59.399084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:59.400348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:59.474279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1051/2141] 10.222.0.99 () {58 vars in 967 bytes} [Fri May 13 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:59.489578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:59.491171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:59.589713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ab175-0c5b-4bda-a79d-4aca3375de06 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:59.596085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:59.596746 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:59.597036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:59.597315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:59.606235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:59.607843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:59.617189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1091/2142] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 14:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:56:59.668226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:59.669711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:59.693763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1381d17-8e4e-4e8e-8b58-9dcbd3694765 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:59.698656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:59.699541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:59.699753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:59.700083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] PATH_INFO: `/v3/projects/a92cf66e949244879a4f1e71d3871654` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:59.702089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92cf66e949244879a4f1e71d3871654)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:59.704261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:59.755193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92cf66e949244879a4f1e71d3871654', 'request_id': 'req-b6ea5901-a1fe-42d1-874c-9b2e4901c128'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.762005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92cf66e949244879a4f1e71d3871654', 'request_id': 'req-b6ea5901-a1fe-42d1-874c-9b2e4901c128'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.770901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92cf66e949244879a4f1e71d3871654', 'request_id': 'req-b6ea5901-a1fe-42d1-874c-9b2e4901c128'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.785726 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] The token cache is being invalidate because project a92cf66e949244879a4f1e71d3871654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:56:59.786022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.786681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.788276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1052/2143] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:56:59 2022] DELETE /identity/v3/projects/a92cf66e949244879a4f1e71d3871654 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:56:59.792345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:59.803307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ea4b-efb5-41eb-934a-457de25a0706 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:59.865253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:59.866131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:59.866407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:59.866680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] PATH_INFO: `/v3/users/14a212d395f848c8be3f3e42ec6ea431` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:59.867861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a212d395f848c8be3f3e42ec6ea431)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:59.869886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:59.921170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a212d395f848c8be3f3e42ec6ea431'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.928835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a212d395f848c8be3f3e42ec6ea431'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.941722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a212d395f848c8be3f3e42ec6ea431'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.948831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a212d395f848c8be3f3e42ec6ea431'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.949558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67082865-f5e2-4955-b7bf-78197608b67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a212d395f848c8be3f3e42ec6ea431'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:56:59.956074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1092/2144] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:56:59 2022] DELETE /identity/v3/users/14a212d395f848c8be3f3e42ec6ea431 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:00.259887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:00.261469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:00.277773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea5901-a1fe-42d1-874c-9b2e4901c128 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:00.345008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:00.346142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.346493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.346838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] PATH_INFO: `/v3/projects/d09a5ce789a04431bbf1c96711aa12f1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.348165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09a5ce789a04431bbf1c96711aa12f1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:00.350394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:00.404615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09a5ce789a04431bbf1c96711aa12f1', 'request_id': 'req-eb4041fd-f6c7-4e08-82da-837932292348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:00.411347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09a5ce789a04431bbf1c96711aa12f1', 'request_id': 'req-eb4041fd-f6c7-4e08-82da-837932292348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:00.424249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09a5ce789a04431bbf1c96711aa12f1', 'request_id': 'req-eb4041fd-f6c7-4e08-82da-837932292348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:00.435790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] The token cache is being invalidate because project d09a5ce789a04431bbf1c96711aa12f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:00.436269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:00.436951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4041fd-f6c7-4e08-82da-837932292348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:00.438749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1053/2145] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:00 2022] DELETE /identity/v3/projects/d09a5ce789a04431bbf1c96711aa12f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:00.443744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3061-7a09-416f-b5af-7bd9db825b21 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.444152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3061-7a09-416f-b5af-7bd9db825b21 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.444497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3061-7a09-416f-b5af-7bd9db825b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.476581 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6b4d3061-7a09-416f-b5af-7bd9db825b21 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:00.477842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6b4d3061-7a09-416f-b5af-7bd9db825b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:00.540823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1093/2146] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:00.549310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f79ad-f685-471e-bf79-74dd27e6a6eb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.549772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f79ad-f685-471e-bf79-74dd27e6a6eb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.550313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f79ad-f685-471e-bf79-74dd27e6a6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.569145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1a1f79ad-f685-471e-bf79-74dd27e6a6eb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:00.570398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1a1f79ad-f685-471e-bf79-74dd27e6a6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:00.578410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1054/2147] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:00.582908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d3061-7a09-416f-b5af-7bd9db825b21 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:00.592874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d3061-7a09-416f-b5af-7bd9db825b21 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:00.597824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:00.598596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.598926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.599233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.600104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:57:00.600417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:00.602137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:00.619432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1094/2148] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:57:00.621008 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f79ad-f685-471e-bf79-74dd27e6a6eb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:00.630622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f79ad-f685-471e-bf79-74dd27e6a6eb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:00.636054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:00.636722 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.637006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.637277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.637967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:00.640023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:00.671995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1055/2149] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:57:00 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:00.673197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:00.683305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74963d-6493-4822-8f15-255e41dfeb69 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:00.739708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:00.740410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.740697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.740971 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.741678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:00.743621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:00.765478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1095/2150] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:57:00 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:57:00.770017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:00.781024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130275-3d7f-4108-b67c-ce72b6ca3209 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:00.786082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:00.786751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.787030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.787322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.788429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:00.790521 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:00.801838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1056/2151] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:00.805918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:00.816332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8392244-b040-4e69-bcfc-ae03af376e17 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:00.821754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f0387-c1b6-40e6-9970-7e215194b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:00.822600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f0387-c1b6-40e6-9970-7e215194b375 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.822909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f0387-c1b6-40e6-9970-7e215194b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.823657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f0387-c1b6-40e6-9970-7e215194b375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.823962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f0387-c1b6-40e6-9970-7e215194b375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:00.825626 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f0387-c1b6-40e6-9970-7e215194b375 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:00.836426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1096/2152] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:00.840803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:00.853308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db47d47-7997-4e15-8bdf-f09d9676d8ca admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:00.859005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:00.860398 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.860489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.860730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] PATH_INFO: `/v3/projects/61ca902491184deb9090d5ff0cd1561b/users/6aca5fab15e3466983783bf4ab48f925/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.878365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ca902491184deb9090d5ff0cd1561b, user_id=6aca5fab15e3466983783bf4ab48f925, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:00.881078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:00.894563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1057/2153] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:00 2022] PUT /identity/v3/projects/61ca902491184deb9090d5ff0cd1561b/users/6aca5fab15e3466983783bf4ab48f925/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:00.905686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2a39c-7e93-47bf-9b01-6a0bae89a6b9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:00.905979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2a39c-7e93-47bf-9b01-6a0bae89a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:00.906267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2a39c-7e93-47bf-9b01-6a0bae89a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:00.934170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-17a2a39c-7e93-47bf-9b01-6a0bae89a6b9 None None] MFA Rules not processed for user `6aca5fab15e3466983783bf4ab48f925`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:00.935464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-17a2a39c-7e93-47bf-9b01-6a0bae89a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:01.000150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1097/2154] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:01.005921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.068676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227aa0be-3fcf-4f49-bedf-6346b34effd6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.076108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.077135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.077244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.077463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.078187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.081124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.123022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1058/2155] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:57:01 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:01.124438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2a39c-7e93-47bf-9b01-6a0bae89a6b9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.141213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2a39c-7e93-47bf-9b01-6a0bae89a6b9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.201827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.202543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.202823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.203104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.205011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.205866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.235482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1098/2156] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:57:01 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:01.239936 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.252701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62456-e455-470d-8bcc-45dafa95b65c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.257561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.258228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.258505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.258779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.260755 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.262330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.275917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1059/2157] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:01.280713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.292465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21722d01-d502-493c-a9b0-ef68f7c21a70 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.297578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.298713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.299052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.299344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] PATH_INFO: `/v3/projects/76342d9cb3ec442b89f4c345678b71ae/users/88e9596cfc784d1999ef8ef581a66616/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.315337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76342d9cb3ec442b89f4c345678b71ae, user_id=88e9596cfc784d1999ef8ef581a66616, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.318098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.346465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1099/2158] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:01 2022] PUT /identity/v3/projects/76342d9cb3ec442b89f4c345678b71ae/users/88e9596cfc784d1999ef8ef581a66616/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:01.350595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.363744 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1118e5-fdb7-4208-b5b6-43acb90d46dd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.435933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f6003-d81b-4281-9658-05f0ba9e5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.436711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6003-d81b-4281-9658-05f0ba9e5269 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.437201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6003-d81b-4281-9658-05f0ba9e5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.437484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f6003-d81b-4281-9658-05f0ba9e5269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.438917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f6003-d81b-4281-9658-05f0ba9e5269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.440708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f6003-d81b-4281-9658-05f0ba9e5269 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.452191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1060/2159] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:01.457938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.476879 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cebdb6-8825-417f-9ee9-b26c56799e12 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.482232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecbd47-3f0c-4c4f-bde8-9ff9a3ea0c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.484482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecbd47-3f0c-4c4f-bde8-9ff9a3ea0c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.484980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecbd47-3f0c-4c4f-bde8-9ff9a3ea0c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.485322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecbd47-3f0c-4c4f-bde8-9ff9a3ea0c2f admin admin] PATH_INFO: `/v3/projects/76342d9cb3ec442b89f4c345678b71ae/users/88e9596cfc784d1999ef8ef581a66616/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.489106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecbd47-3f0c-4c4f-bde8-9ff9a3ea0c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76342d9cb3ec442b89f4c345678b71ae, user_id=88e9596cfc784d1999ef8ef581a66616, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.492231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecbd47-3f0c-4c4f-bde8-9ff9a3ea0c2f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.504166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.504623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.505004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.513606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1100/2160] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:01 2022] PUT /identity/v3/projects/76342d9cb3ec442b89f4c345678b71ae/users/88e9596cfc784d1999ef8ef581a66616/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:01.515733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.515966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.516311 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.530217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] MFA Rules not processed for user `18907451ac014573ba51f5f5f3939381`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:01.531534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:01.546635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] MFA Rules not processed for user `88e9596cfc784d1999ef8ef581a66616`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:01.549483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:01.593849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1061/2161] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:01.628442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1101/2162] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:01.640182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.641952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:01.670320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:01.671908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:01.743143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51630bdd-b4c1-4861-b70a-36f9151bffc7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.746527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906664a0-8f72-47ef-b35c-1bdb1efe8133 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:01.747694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.748425 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.748709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.748982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.751957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:01.753373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.753939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.754425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] PATH_INFO: `/v3/users/d8b43419aba7485989facb2d0ed8f1aa` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.756354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b43419aba7485989facb2d0ed8f1aa)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.759691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.760922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:01.762481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:01.775460 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1062/2163] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:57:01.822554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b43419aba7485989facb2d0ed8f1aa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:01.831770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b43419aba7485989facb2d0ed8f1aa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:01.847283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b43419aba7485989facb2d0ed8f1aa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:01.854410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b43419aba7485989facb2d0ed8f1aa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:01.855642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b43419aba7485989facb2d0ed8f1aa'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:01.867448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1102/2164] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:57:01 2022] DELETE /identity/v3/users/d8b43419aba7485989facb2d0ed8f1aa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:02.091547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.105449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade10b7c-0230-44cd-9d98-07290cfeb28c service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.177642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.178691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.179140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.180068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] PATH_INFO: `/v3/projects/96f1f8287c8c4c0da430dc5daef01813` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.183815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f1f8287c8c4c0da430dc5daef01813)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.185824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.237600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.239058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.246535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f1f8287c8c4c0da430dc5daef01813', 'request_id': 'req-5e070f4a-de95-4226-90ee-d386b121b42a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.252955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f1f8287c8c4c0da430dc5daef01813', 'request_id': 'req-5e070f4a-de95-4226-90ee-d386b121b42a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.253785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcc175-5d2f-4023-a0a5-5dbcf2822c44 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.261987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f1f8287c8c4c0da430dc5daef01813', 'request_id': 'req-5e070f4a-de95-4226-90ee-d386b121b42a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.279364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] The token cache is being invalidate because project 96f1f8287c8c4c0da430dc5daef01813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:02.279655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.280366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e070f4a-de95-4226-90ee-d386b121b42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.281966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1063/2165] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:02 2022] DELETE /identity/v3/projects/96f1f8287c8c4c0da430dc5daef01813 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:02.289601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ec54-a4d3-409a-bb79-fbe40b194186 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.290083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ec54-a4d3-409a-bb79-fbe40b194186 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.290537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ec54-a4d3-409a-bb79-fbe40b194186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.309820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b781ec54-a4d3-409a-bb79-fbe40b194186 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:02.311089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b781ec54-a4d3-409a-bb79-fbe40b194186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.324024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.325452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.325452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.325858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] PATH_INFO: `/v3/users/6aca5fab15e3466983783bf4ab48f925` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.327425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aca5fab15e3466983783bf4ab48f925)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.329922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.395779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1064/2166] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:02.396112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aca5fab15e3466983783bf4ab48f925'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.397481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4fc8-39da-4a91-b2c5-4110ebb097fb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.397769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4fc8-39da-4a91-b2c5-4110ebb097fb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.398043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4fc8-39da-4a91-b2c5-4110ebb097fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.407588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aca5fab15e3466983783bf4ab48f925'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.419114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-561a4fc8-39da-4a91-b2c5-4110ebb097fb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:02.420486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-561a4fc8-39da-4a91-b2c5-4110ebb097fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.420726 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aca5fab15e3466983783bf4ab48f925'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.429152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aca5fab15e3466983783bf4ab48f925'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.429631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1065/2167] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:02.430278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-186325c6-d7af-4e93-9157-b3b50011d175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aca5fab15e3466983783bf4ab48f925'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:02.433860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4fc8-39da-4a91-b2c5-4110ebb097fb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.437134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1103/2168] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:57:02 2022] DELETE /identity/v3/users/6aca5fab15e3466983783bf4ab48f925 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:57:02.441708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.442048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.442388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.444078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4fc8-39da-4a91-b2c5-4110ebb097fb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.460229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:02.461530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.504752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.505419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.505704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.505981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.506776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:57:02.507083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.508988 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.527806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1066/2169] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:57:02.527983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1104/2170] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:02.533250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.534711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.535223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.536374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.548242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94ef5-dd22-4fab-9ed6-871ee17f28cb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.553156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.553821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.554106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.554382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.555111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.557074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.587738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1067/2171] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:57:02 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:02.591499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.596925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7e326-4eea-4c25-9760-4c8978f6f1c9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.655251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.655489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c9d7-f033-40e4-b484-28b5dc449d3a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.656396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.657023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.657501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.660964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.661644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.661928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.662202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.662928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.664931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.668928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.670324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.681023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1105/2172] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:02.689565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1068/2173] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:57:02 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:57:02.694642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.704212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6107-a990-4067-a074-d1d2ba1ff347 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.708948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.709705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.709989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.710279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.710994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.712656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.726785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1106/2174] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:02.728144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.739647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40563-d6b1-4abb-bb97-520753384e90 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.744668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a0fb5-b021-4ef1-b91a-f32adf4b7420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.745401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0fb5-b021-4ef1-b91a-f32adf4b7420 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.745692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0fb5-b021-4ef1-b91a-f32adf4b7420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.745968 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0fb5-b021-4ef1-b91a-f32adf4b7420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.746719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a0fb5-b021-4ef1-b91a-f32adf4b7420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.748384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a0fb5-b021-4ef1-b91a-f32adf4b7420 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.762465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1069/2175] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:02.763688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.775767 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203412-97bc-4288-8774-f6f6c3742585 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.780700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.781551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.781854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.782137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] PATH_INFO: `/v3/projects/9cf795995a52452f93da8f04eb878e7b/users/08b114f5b57146d8b4324231982ce7d4/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.800410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf795995a52452f93da8f04eb878e7b, user_id=08b114f5b57146d8b4324231982ce7d4, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.803401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.818742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1107/2176] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:02 2022] PUT /identity/v3/projects/9cf795995a52452f93da8f04eb878e7b/users/08b114f5b57146d8b4324231982ce7d4/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:57:02.824020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.824808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.825362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.848777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:02.849765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.910357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1070/2177] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:02.920743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.963164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:02.965007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:02.983492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090823d-9f9e-46a9-b22c-174f5afbf58b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.991565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.992286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faade06d-66dd-4e6a-922e-ceec3534d73c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:02.992518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.992798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.992997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] PATH_INFO: `/v3/projects/61ca902491184deb9090d5ff0cd1561b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:02.994234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ca902491184deb9090d5ff0cd1561b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:02.996283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:02.996498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:02.997266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:02.997552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:02.997827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:03.007350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:03.008822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:03.018415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1108/2178] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:03.051147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ca902491184deb9090d5ff0cd1561b', 'request_id': 'req-8fe3311f-4094-480d-80ba-7abe85e5647b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.057459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ca902491184deb9090d5ff0cd1561b', 'request_id': 'req-8fe3311f-4094-480d-80ba-7abe85e5647b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.065887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ca902491184deb9090d5ff0cd1561b', 'request_id': 'req-8fe3311f-4094-480d-80ba-7abe85e5647b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.077282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] The token cache is being invalidate because project 61ca902491184deb9090d5ff0cd1561b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:03.077570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.078221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.081088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1071/2179] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:02 2022] DELETE /identity/v3/projects/61ca902491184deb9090d5ff0cd1561b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:03.085823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:03.095749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269400-45ce-4d61-88e3-a62761706410 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:03.155038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:03.155956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:03.156243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:03.156517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] PATH_INFO: `/v3/users/88e9596cfc784d1999ef8ef581a66616` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:03.158393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e9596cfc784d1999ef8ef581a66616)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:03.160436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:03.210094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e9596cfc784d1999ef8ef581a66616'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.217931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e9596cfc784d1999ef8ef581a66616'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.231302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e9596cfc784d1999ef8ef581a66616'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.239926 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e9596cfc784d1999ef8ef581a66616'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.241124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0f0255a8-ec31-4de9-86f4-e2b97351e850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e9596cfc784d1999ef8ef581a66616'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.247339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1109/2180] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:57:03 2022] DELETE /identity/v3/users/88e9596cfc784d1999ef8ef581a66616 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:57:03.767976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:03.769558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:03.782635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3311f-4094-480d-80ba-7abe85e5647b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:03.865822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:03.866811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:03.867101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:03.867381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] PATH_INFO: `/v3/projects/76342d9cb3ec442b89f4c345678b71ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:03.868960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76342d9cb3ec442b89f4c345678b71ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:03.871507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:03.891909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:03.892355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:03.893209 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:03.936574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76342d9cb3ec442b89f4c345678b71ae', 'request_id': 'req-e94dfd02-9c66-466f-98f8-bfa0127bc303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.936846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] MFA Rules not processed for user `08b114f5b57146d8b4324231982ce7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:03.937961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:03.947990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76342d9cb3ec442b89f4c345678b71ae', 'request_id': 'req-e94dfd02-9c66-466f-98f8-bfa0127bc303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.960321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76342d9cb3ec442b89f4c345678b71ae', 'request_id': 'req-e94dfd02-9c66-466f-98f8-bfa0127bc303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.984719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] The token cache is being invalidate because project 76342d9cb3ec442b89f4c345678b71ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:03.986370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.992337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e94dfd02-9c66-466f-98f8-bfa0127bc303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:03.994324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1072/2181] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:03 2022] DELETE /identity/v3/projects/76342d9cb3ec442b89f4c345678b71ae => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:03.999021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd698-5b06-4c3c-a1b6-35808da523d9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:03.999412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd698-5b06-4c3c-a1b6-35808da523d9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:03.999780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd698-5b06-4c3c-a1b6-35808da523d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.017194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1110/2182] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:04.024287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-561bd698-5b06-4c3c-a1b6-35808da523d9 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:04.025778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-561bd698-5b06-4c3c-a1b6-35808da523d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:04.027941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.029308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:04.089578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e1cb-75db-467d-b292-f2f8bbb073af None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.093979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f2ed9-29c0-4c67-a000-60cfbdd1d174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.094686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f2ed9-29c0-4c67-a000-60cfbdd1d174 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.094973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f2ed9-29c0-4c67-a000-60cfbdd1d174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.095249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f2ed9-29c0-4c67-a000-60cfbdd1d174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.105103 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f2ed9-29c0-4c67-a000-60cfbdd1d174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.106572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f2ed9-29c0-4c67-a000-60cfbdd1d174 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.116141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1111/2183] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:57:04.118703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1073/2184] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:04.128349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0ce4-e1b9-42ba-8734-d21229ac25ee None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.128642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0ce4-e1b9-42ba-8734-d21229ac25ee None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.128918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0ce4-e1b9-42ba-8734-d21229ac25ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.147499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cc6f0ce4-e1b9-42ba-8734-d21229ac25ee None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:04.148959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cc6f0ce4-e1b9-42ba-8734-d21229ac25ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:04.159996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1112/2185] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:04.164147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd698-5b06-4c3c-a1b6-35808da523d9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.175106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd698-5b06-4c3c-a1b6-35808da523d9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.180926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.181701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.182058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.182403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.183322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:57:04.183665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.185401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.203283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1074/2186] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:57:04.204858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0ce4-e1b9-42ba-8734-d21229ac25ee None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.214574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0ce4-e1b9-42ba-8734-d21229ac25ee None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.221083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.222061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.222447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.222821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.223634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.225745 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.258736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1113/2187] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:57:04 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:04.262953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.273731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9ce74-9bcd-4fc0-9548-2ee9ade294fe admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.360319 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.360968 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.361250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.363542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.364300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.366316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.394736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1075/2188] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:57:04 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:04.399038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.414333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba394688-a2c3-45a4-8caf-9bdd1060e50c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.419578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.420639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.421148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.421511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.422403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.424482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.437899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1114/2189] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:57:04.442040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.460069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08d006-f5b0-423c-b9b1-cec666b33753 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.467491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a1f34-c2d7-452e-aab2-157395ba569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.467751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1f34-c2d7-452e-aab2-157395ba569b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.468055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1f34-c2d7-452e-aab2-157395ba569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.468393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a1f34-c2d7-452e-aab2-157395ba569b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.470636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a1f34-c2d7-452e-aab2-157395ba569b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.471048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a1f34-c2d7-452e-aab2-157395ba569b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.491027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1076/2190] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:04.492659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.504879 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a694d4-2397-4733-9438-da67abc62193 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.513022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.513022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.513022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.513022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] PATH_INFO: `/v3/projects/113961474ff04656ae993195ac52ed12/users/09ef78dd243d4243b1f5e8bdad3d395d/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.527625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113961474ff04656ae993195ac52ed12, user_id=09ef78dd243d4243b1f5e8bdad3d395d, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.530353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.563945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1115/2191] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:04 2022] PUT /identity/v3/projects/113961474ff04656ae993195ac52ed12/users/09ef78dd243d4243b1f5e8bdad3d395d/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:04.571626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5b707-5a55-4769-af31-74138f9684c2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.572004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5b707-5a55-4769-af31-74138f9684c2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.572442 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5b707-5a55-4769-af31-74138f9684c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.609252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a3c5b707-5a55-4769-af31-74138f9684c2 None None] MFA Rules not processed for user `09ef78dd243d4243b1f5e8bdad3d395d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:04.610788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a3c5b707-5a55-4769-af31-74138f9684c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:04.687378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1077/2192] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:04.721689 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.777867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad1e4-d106-4abb-9626-dd3ba5be83a1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.781699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61c28-a5a1-4850-b0d6-ffd4f6ae78dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.782238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61c28-a5a1-4850-b0d6-ffd4f6ae78dd service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.782507 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61c28-a5a1-4850-b0d6-ffd4f6ae78dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.782812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61c28-a5a1-4850-b0d6-ffd4f6ae78dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.791659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61c28-a5a1-4850-b0d6-ffd4f6ae78dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.792945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61c28-a5a1-4850-b0d6-ffd4f6ae78dd service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.802306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1116/2193] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:04.816291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5b707-5a55-4769-af31-74138f9684c2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:04.879996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5b707-5a55-4769-af31-74138f9684c2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:04.884940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:04.885826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.886104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.886444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] PATH_INFO: `/v3/users/09ef78dd243d4243b1f5e8bdad3d395d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:04.888148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ef78dd243d4243b1f5e8bdad3d395d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:04.891846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:04.950911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ef78dd243d4243b1f5e8bdad3d395d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:04.958922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ef78dd243d4243b1f5e8bdad3d395d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:04.959809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ef78dd243d4243b1f5e8bdad3d395d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:04.973373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ef78dd243d4243b1f5e8bdad3d395d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:04.974107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ef78dd243d4243b1f5e8bdad3d395d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:04.989329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1078/2194] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:57:04 2022] DELETE /identity/v3/users/09ef78dd243d4243b1f5e8bdad3d395d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:04.993704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:04.994084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:04.994455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.014205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:05.015658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:05.083385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1117/2195] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:05.096569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:05.098051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:05.157401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e8091-9ddc-4acb-98aa-d213a104f854 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:05.161553 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4670471-7b69-4f60-93e0-1a668877151b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:05.162674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4670471-7b69-4f60-93e0-1a668877151b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.162966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4670471-7b69-4f60-93e0-1a668877151b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.163343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4670471-7b69-4f60-93e0-1a668877151b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.175793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4670471-7b69-4f60-93e0-1a668877151b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:05.177745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4670471-7b69-4f60-93e0-1a668877151b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:05.204995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1079/2196] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:05.498809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:05.502185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:05.524921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf80f-4bce-41de-b33e-9a588b1f3d43 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:05.530568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:05.531806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.532210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.532521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] PATH_INFO: `/v3/projects/113961474ff04656ae993195ac52ed12` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.534305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=113961474ff04656ae993195ac52ed12)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:05.536897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:05.552847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa432-4858-41cd-bfc1-ef00eceec1f1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.553135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa432-4858-41cd-bfc1-ef00eceec1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.553434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa432-4858-41cd-bfc1-ef00eceec1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.572078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-646fa432-4858-41cd-bfc1-ef00eceec1f1 None None] MFA Rules not processed for user `08b114f5b57146d8b4324231982ce7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:05.573311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-646fa432-4858-41cd-bfc1-ef00eceec1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:05.589178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113961474ff04656ae993195ac52ed12', 'request_id': 'req-dbd73071-691b-4ff2-88f0-ece24b798a3b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:05.596201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113961474ff04656ae993195ac52ed12', 'request_id': 'req-dbd73071-691b-4ff2-88f0-ece24b798a3b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:05.606806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113961474ff04656ae993195ac52ed12', 'request_id': 'req-dbd73071-691b-4ff2-88f0-ece24b798a3b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:05.621514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] The token cache is being invalidate because project 113961474ff04656ae993195ac52ed12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:05.622268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:05.623222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dbd73071-691b-4ff2-88f0-ece24b798a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:05.625596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1118/2197] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:05 2022] DELETE /identity/v3/projects/113961474ff04656ae993195ac52ed12 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:05.632457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c21f-25be-41c0-bf35-c460041b0264 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.633040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c21f-25be-41c0-bf35-c460041b0264 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.633657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c21f-25be-41c0-bf35-c460041b0264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.635150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1080/2198] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:05.656321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b066c21f-25be-41c0-bf35-c460041b0264 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:05.657671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b066c21f-25be-41c0-bf35-c460041b0264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:05.724987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1119/2199] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:05.733399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3329d-1f57-4a69-b55b-ef66e460fe45 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.733702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3329d-1f57-4a69-b55b-ef66e460fe45 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.733978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3329d-1f57-4a69-b55b-ef66e460fe45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.753580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-10e3329d-1f57-4a69-b55b-ef66e460fe45 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:05.755488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-10e3329d-1f57-4a69-b55b-ef66e460fe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:05.763822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1081/2200] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:05.768346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066c21f-25be-41c0-bf35-c460041b0264 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:05.778519 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066c21f-25be-41c0-bf35-c460041b0264 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:05.783427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:05.784130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.784415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.784688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.785954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:57:05.785954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:05.787451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:05.802873 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1120/2201] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 14:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:57:05.804264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3329d-1f57-4a69-b55b-ef66e460fe45 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:05.813388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3329d-1f57-4a69-b55b-ef66e460fe45 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:05.818171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:05.818836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.819115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.819387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.820114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:05.822063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:05.851171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1082/2202] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:57:05 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:05.852647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:05.864039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7dc2-383b-4a02-a7a6-652239e89133 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:05.920501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:05.921181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.921462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.921735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.922469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:05.924703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:05.948391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1121/2203] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:57:05 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:05.949591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:05.960740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecda9e-658a-4cc7-b629-9f0b2ad76e53 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:05.966331 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:05.967102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:05.967386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:05.967675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:05.968497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:05.970621 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:05.986860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1083/2204] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:05.990924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.000963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c46b-b860-4206-ad3c-258e0d69472e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.005904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e377d0a-9f78-4c3c-8028-a29fa86db5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.006636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e377d0a-9f78-4c3c-8028-a29fa86db5af admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.007003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e377d0a-9f78-4c3c-8028-a29fa86db5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.007343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e377d0a-9f78-4c3c-8028-a29fa86db5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.008165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e377d0a-9f78-4c3c-8028-a29fa86db5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.009870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e377d0a-9f78-4c3c-8028-a29fa86db5af admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.021531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1122/2205] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:57:06.025778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.041988 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc05ae-9950-4a08-8047-28defa81076a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.046753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.048047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.048399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.048738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] PATH_INFO: `/v3/projects/6ff83f2fd8f541bcbaedf5b19ec8d8ca/users/3d0f30bdd7464f41be71f3e4c169a2ad/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.063249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff83f2fd8f541bcbaedf5b19ec8d8ca, user_id=3d0f30bdd7464f41be71f3e4c169a2ad, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.066231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.080502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1084/2206] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:06 2022] PUT /identity/v3/projects/6ff83f2fd8f541bcbaedf5b19ec8d8ca/users/3d0f30bdd7464f41be71f3e4c169a2ad/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:06.091799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4816e-7373-4048-92f4-c92a6290ae48 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.092124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4816e-7373-4048-92f4-c92a6290ae48 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.092406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4816e-7373-4048-92f4-c92a6290ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.120436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-44a4816e-7373-4048-92f4-c92a6290ae48 None None] MFA Rules not processed for user `3d0f30bdd7464f41be71f3e4c169a2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:06.121649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-44a4816e-7373-4048-92f4-c92a6290ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:06.186424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1123/2207] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:06.191183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.254183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5d29-6268-4a62-ab54-673920d5fc1e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.260578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.261247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.261526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.261803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.262671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.264673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.296090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1085/2208] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:57:06 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:06.297214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4816e-7373-4048-92f4-c92a6290ae48 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.308241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4816e-7373-4048-92f4-c92a6290ae48 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.367719 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.368433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.368730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.369039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.369697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.371600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.395513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1124/2209] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:57:06 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:57:06.399283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.410419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da4ffb-941e-4aa4-a02e-be29e5a2979b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.415374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.416191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.416472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.416755 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.417554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.419261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.431717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1086/2210] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:06.435798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.445577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819a78a-d70b-4443-88fb-3c4a9815befc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.451131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d102857-fdd2-4606-b593-2c759c1b5f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.451809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d102857-fdd2-4606-b593-2c759c1b5f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.452135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d102857-fdd2-4606-b593-2c759c1b5f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.452417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d102857-fdd2-4606-b593-2c759c1b5f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.453201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d102857-fdd2-4606-b593-2c759c1b5f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.455552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d102857-fdd2-4606-b593-2c759c1b5f6f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.470155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1125/2211] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:06.471591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.484751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13161-8fd9-4080-bc05-1c343cf511e0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.490200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.491209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.491558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.491958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] PATH_INFO: `/v3/projects/a999a22dbfc64df5b446e22136c21ade/users/490da29a00d841f4a5a6a39b42cf0f00/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.507590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a999a22dbfc64df5b446e22136c21ade, user_id=490da29a00d841f4a5a6a39b42cf0f00, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.510606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.526330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1087/2212] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:06 2022] PUT /identity/v3/projects/a999a22dbfc64df5b446e22136c21ade/users/490da29a00d841f4a5a6a39b42cf0f00/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:06.536981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a99118-c12a-4d62-83f9-0928ff3be6a8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.537520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a99118-c12a-4d62-83f9-0928ff3be6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.537520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a99118-c12a-4d62-83f9-0928ff3be6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.564709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-95a99118-c12a-4d62-83f9-0928ff3be6a8 None None] MFA Rules not processed for user `490da29a00d841f4a5a6a39b42cf0f00`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:06.565978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-95a99118-c12a-4d62-83f9-0928ff3be6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:06.630866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1126/2213] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:06.635635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.694655 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4e9f9-ea07-4bd5-9be0-8fb10226a092 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.702492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.703538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.703984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.704267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.705297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.708907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.742815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1088/2214] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 14:57:06 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:06.747118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a99118-c12a-4d62-83f9-0928ff3be6a8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.758124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a99118-c12a-4d62-83f9-0928ff3be6a8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.815443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.816171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.816462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.816736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.817429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.819355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.841888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1127/2215] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 14:57:06 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:57:06.846293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.856991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62992688-092b-4a1c-8ec6-d7ead84dede6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.864021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.865059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.865459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.865819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.866890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.869477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.886249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1089/2216] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:06.890548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.901843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85d595-d7a4-439a-8e44-4b5371b7ae1d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:06.906787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:06.907696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:06.908005 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:06.908280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] PATH_INFO: `/v3/projects/2cea7d07efef47fb811c8881712dd85f/users/4790f9d977d049e18bc1d11388bc935e/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:06.925080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cea7d07efef47fb811c8881712dd85f, user_id=4790f9d977d049e18bc1d11388bc935e, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:06.927824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:06.941943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1128/2217] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:06 2022] PUT /identity/v3/projects/2cea7d07efef47fb811c8881712dd85f/users/4790f9d977d049e18bc1d11388bc935e/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:06.946133 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:06.956785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d909f-690f-429e-b476-2fafc8639e9a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:07.020673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e630c-c9e4-4db4-9f81-7aab6059b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:07.021933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e630c-c9e4-4db4-9f81-7aab6059b28a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.022225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e630c-c9e4-4db4-9f81-7aab6059b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.022507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e630c-c9e4-4db4-9f81-7aab6059b28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.023250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e630c-c9e4-4db4-9f81-7aab6059b28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:07.025050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e630c-c9e4-4db4-9f81-7aab6059b28a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:07.035971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1090/2218] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:57:07.040291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:07.051610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81020b1d-a941-4bf4-ba82-62138965f246 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:07.056732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:07.057729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.058110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.058480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] PATH_INFO: `/v3/projects/2cea7d07efef47fb811c8881712dd85f/users/4790f9d977d049e18bc1d11388bc935e/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.060672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cea7d07efef47fb811c8881712dd85f, user_id=4790f9d977d049e18bc1d11388bc935e, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:07.064172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:07.074938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1129/2219] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 14:57:07 2022] PUT /identity/v3/projects/2cea7d07efef47fb811c8881712dd85f/users/4790f9d977d049e18bc1d11388bc935e/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:57:07.087287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.087580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.087877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.118854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] MFA Rules not processed for user `4790f9d977d049e18bc1d11388bc935e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:07.120129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:07.188733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1091/2220] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:07.200128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:07.201862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:07.260068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ff24-9721-4ff0-93ba-edfdf239a61b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:07.264461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:07.265123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.265492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.265678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.323565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:07.325188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:07.334744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1130/2221] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:08.837067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:08.838616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:08.860825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:08.862528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:08.874220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cffba3-11cc-4648-a610-2840afebacfa service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:08.878816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:08.879489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:08.879776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:08.880098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:08.935566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9c77b-f74b-4012-b050-dac6cd6d3d80 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:08.941014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:08.941667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:08.942073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:08.942345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:08.943320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:08.944307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:08.944991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:08.955692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1131/2222] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:57:08.957125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:08.959842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:08.975286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1092/2223] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:09.567179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:09.575367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52beba-eef9-4999-b2a0-ddac79fd2ee3 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:09.579556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeba1fa-7d4f-4f3c-8777-b873880b8e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:09.580261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeba1fa-7d4f-4f3c-8777-b873880b8e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:09.580543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeba1fa-7d4f-4f3c-8777-b873880b8e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:09.580786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeba1fa-7d4f-4f3c-8777-b873880b8e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:09.590237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeba1fa-7d4f-4f3c-8777-b873880b8e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:09.591721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeba1fa-7d4f-4f3c-8777-b873880b8e49 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:09.601441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1132/2224] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:13.574139 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:13.641933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecfe52-7994-4639-9ce8-edc45ad4398c service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:13.648930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:13.649815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.650099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.650376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] PATH_INFO: `/v3/users/3d0f30bdd7464f41be71f3e4c169a2ad` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.651703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0f30bdd7464f41be71f3e4c169a2ad)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:13.653752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:13.713856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0f30bdd7464f41be71f3e4c169a2ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:13.720795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0f30bdd7464f41be71f3e4c169a2ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:13.721493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0f30bdd7464f41be71f3e4c169a2ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:13.735256 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0f30bdd7464f41be71f3e4c169a2ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:13.736714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0f30bdd7464f41be71f3e4c169a2ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:13.755467 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1093/2225] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:57:13 2022] DELETE /identity/v3/users/3d0f30bdd7464f41be71f3e4c169a2ad => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:13.760416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.760939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.760939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.779611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:13.780872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:13.841754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1133/2226] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:13.851582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:13.853167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:13.910291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01f630-175d-4765-b143-19147701ff5d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:13.914283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:13.914945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.915232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.915517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.925439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:13.926908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:13.937646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1094/2227] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:14.209765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:14.211666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:14.229261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a880f5-a9b2-491a-8f8c-cdb684de9903 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:14.236286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:14.237346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:14.237632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:14.237912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] PATH_INFO: `/v3/projects/6ff83f2fd8f541bcbaedf5b19ec8d8ca` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:14.239250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff83f2fd8f541bcbaedf5b19ec8d8ca)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:14.241138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:14.297062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff83f2fd8f541bcbaedf5b19ec8d8ca', 'request_id': 'req-fd3500ec-ef00-451b-ac9b-d1a420497556'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.303681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff83f2fd8f541bcbaedf5b19ec8d8ca', 'request_id': 'req-fd3500ec-ef00-451b-ac9b-d1a420497556'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.312844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff83f2fd8f541bcbaedf5b19ec8d8ca', 'request_id': 'req-fd3500ec-ef00-451b-ac9b-d1a420497556'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.327050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] The token cache is being invalidate because project 6ff83f2fd8f541bcbaedf5b19ec8d8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:14.327347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.328069 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.329757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1134/2228] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:14 2022] DELETE /identity/v3/projects/6ff83f2fd8f541bcbaedf5b19ec8d8ca => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:14.334678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:14.346635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b973-5986-4888-b054-77355f56d820 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:14.406197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:14.407082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:14.407370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:14.407647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] PATH_INFO: `/v3/users/490da29a00d841f4a5a6a39b42cf0f00` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:14.409103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490da29a00d841f4a5a6a39b42cf0f00)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:14.412803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:14.465201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490da29a00d841f4a5a6a39b42cf0f00'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.482000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490da29a00d841f4a5a6a39b42cf0f00'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.482854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490da29a00d841f4a5a6a39b42cf0f00'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.498510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490da29a00d841f4a5a6a39b42cf0f00'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.500060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490da29a00d841f4a5a6a39b42cf0f00'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.520984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1095/2229] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:57:14 2022] DELETE /identity/v3/users/490da29a00d841f4a5a6a39b42cf0f00 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:14.800333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:14.801938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:14.818943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3500ec-ef00-451b-ac9b-d1a420497556 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:14.886520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:14.887304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:14.887580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:14.887851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] PATH_INFO: `/v3/projects/a999a22dbfc64df5b446e22136c21ade` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:14.889085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a999a22dbfc64df5b446e22136c21ade)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:14.890994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:14.944835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a999a22dbfc64df5b446e22136c21ade', 'request_id': 'req-79940237-2186-4529-b3c4-3ac1bfcc76ee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.952026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a999a22dbfc64df5b446e22136c21ade', 'request_id': 'req-79940237-2186-4529-b3c4-3ac1bfcc76ee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.964336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a999a22dbfc64df5b446e22136c21ade', 'request_id': 'req-79940237-2186-4529-b3c4-3ac1bfcc76ee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.976755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] The token cache is being invalidate because project a999a22dbfc64df5b446e22136c21ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:14.977051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.977819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:14.979389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1135/2230] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:14 2022] DELETE /identity/v3/projects/a999a22dbfc64df5b446e22136c21ade => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:14.984027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:14.985619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:14.999157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d00c72-244e-4fc7-a6bc-0f677956f768 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:15.059063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:15.059981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:15.060268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:15.060565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] PATH_INFO: `/v3/users/4790f9d977d049e18bc1d11388bc935e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:15.061749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4790f9d977d049e18bc1d11388bc935e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:15.063731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:15.115568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4790f9d977d049e18bc1d11388bc935e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.122332 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4790f9d977d049e18bc1d11388bc935e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.123013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4790f9d977d049e18bc1d11388bc935e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.138791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4790f9d977d049e18bc1d11388bc935e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.139737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3622dffb-6c7f-4450-90c1-2553e058eb08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4790f9d977d049e18bc1d11388bc935e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.158283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1096/2231] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 14:57:14 2022] DELETE /identity/v3/users/4790f9d977d049e18bc1d11388bc935e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:15.436185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:15.437816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:15.451380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940237-2186-4529-b3c4-3ac1bfcc76ee admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:15.519978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:15.522157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:15.523207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:15.524540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] PATH_INFO: `/v3/projects/2cea7d07efef47fb811c8881712dd85f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:15.526112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cea7d07efef47fb811c8881712dd85f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:15.528443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:15.584325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cea7d07efef47fb811c8881712dd85f', 'request_id': 'req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.596983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cea7d07efef47fb811c8881712dd85f', 'request_id': 'req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.609723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cea7d07efef47fb811c8881712dd85f', 'request_id': 'req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.623327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] The token cache is being invalidate because project 2cea7d07efef47fb811c8881712dd85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 14:57:15.623621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.624294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a5ebdd62-2ab6-4469-bbff-827bd90e1aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 14:57:15.626110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1136/2232] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 14:57:15 2022] DELETE /identity/v3/projects/2cea7d07efef47fb811c8881712dd85f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:57:38.597795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:38.598366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:38.598469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:38.618792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] MFA Rules not processed for user `1ded6e90b10949dcb921119073f2d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:38.620042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:38.684916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1097/2233] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:58.746602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d7ec-71fe-4d01-a86e-a2cefce0fe54 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:58.747192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d7ec-71fe-4d01-a86e-a2cefce0fe54 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:58.747305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d7ec-71fe-4d01-a86e-a2cefce0fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:58.767070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4bf6d7ec-71fe-4d01-a86e-a2cefce0fe54 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:58.768428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4bf6d7ec-71fe-4d01-a86e-a2cefce0fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:58.833144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1137/2234] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:58.859482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:58.861608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:58.948675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db1fa-3f67-4ce8-b4b9-5faa3766795f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:58.953896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f916a60-a26b-4b33-8707-e3f19024a750 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:58.954832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f916a60-a26b-4b33-8707-e3f19024a750 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:58.955119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f916a60-a26b-4b33-8707-e3f19024a750 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:58.955399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f916a60-a26b-4b33-8707-e3f19024a750 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:58.965599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f916a60-a26b-4b33-8707-e3f19024a750 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:58.967239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f916a60-a26b-4b33-8707-e3f19024a750 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:58.976239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1098/2235] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 14:57:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:58:21.707288 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684c6a-64af-4d88-b782-15cea0a5b975 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:21.707953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684c6a-64af-4d88-b782-15cea0a5b975 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:21.707953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684c6a-64af-4d88-b782-15cea0a5b975 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:21.710585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1138/2236] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:21.717056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0896-4e76-4e78-b9aa-d4a08ac6cbce None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:21.717615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0896-4e76-4e78-b9aa-d4a08ac6cbce None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:21.717615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0896-4e76-4e78-b9aa-d4a08ac6cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:21.768579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d2bf0896-4e76-4e78-b9aa-d4a08ac6cbce None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:21.769801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d2bf0896-4e76-4e78-b9aa-d4a08ac6cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:21.851367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1099/2237] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:21.863028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684c6a-64af-4d88-b782-15cea0a5b975 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:21.864807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-65684c6a-64af-4d88-b782-15cea0a5b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:21.947061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684c6a-64af-4d88-b782-15cea0a5b975 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:21.951176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0e5a6-ad50-4002-b985-fc4c307a25f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:21.951821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e5a6-ad50-4002-b985-fc4c307a25f4 service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:21.952128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e5a6-ad50-4002-b985-fc4c307a25f4 service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:21.952407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0e5a6-ad50-4002-b985-fc4c307a25f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:21.962584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0e5a6-ad50-4002-b985-fc4c307a25f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:21.964118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0e5a6-ad50-4002-b985-fc4c307a25f4 service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:21.974775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1139/2238] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:22.053617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4208f-8fa2-41bb-9400-82e89552d36b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.054021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4208f-8fa2-41bb-9400-82e89552d36b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.054302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4208f-8fa2-41bb-9400-82e89552d36b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.055711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1100/2239] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:22.060686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871d70-974f-472e-b9c6-ac013b1fc901 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.060979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871d70-974f-472e-b9c6-ac013b1fc901 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.061254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871d70-974f-472e-b9c6-ac013b1fc901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.080346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f6871d70-974f-472e-b9c6-ac013b1fc901 None None] MFA Rules not processed for user `81e8247739e24fcd9b067f1aa1cb9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:22.081559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f6871d70-974f-472e-b9c6-ac013b1fc901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:22.133346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1140/2240] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:22.148418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4208f-8fa2-41bb-9400-82e89552d36b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:22.150622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-78d4208f-8fa2-41bb-9400-82e89552d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:22.164864 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4208f-8fa2-41bb-9400-82e89552d36b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:22.168890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222768fd-26da-4b7c-a1c0-a0874769591b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:22.169539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222768fd-26da-4b7c-a1c0-a0874769591b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.169819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222768fd-26da-4b7c-a1c0-a0874769591b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.170077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222768fd-26da-4b7c-a1c0-a0874769591b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.177891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222768fd-26da-4b7c-a1c0-a0874769591b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:22.179560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222768fd-26da-4b7c-a1c0-a0874769591b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:22.187642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1101/2241] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:22.273598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c455f1-7e5e-447c-a915-e7b0db91c829 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.273870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c455f1-7e5e-447c-a915-e7b0db91c829 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.274155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c455f1-7e5e-447c-a915-e7b0db91c829 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.275562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1141/2242] 10.222.0.99 () {54 vars in 921 bytes} [Fri May 13 14:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:22.281337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654520a-037b-4575-ad1d-a43f4fd3ad2a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.281700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654520a-037b-4575-ad1d-a43f4fd3ad2a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.282044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654520a-037b-4575-ad1d-a43f4fd3ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.302478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7654520a-037b-4575-ad1d-a43f4fd3ad2a None None] MFA Rules not processed for user `38f74d30b6da44cb8f60e87f44da4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:22.303942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7654520a-037b-4575-ad1d-a43f4fd3ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:22.314279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1102/2243] 10.222.0.99 () {58 vars in 1018 bytes} [Fri May 13 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:22.325760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c455f1-7e5e-447c-a915-e7b0db91c829 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:22.327495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c8c455f1-7e5e-447c-a915-e7b0db91c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:22.341188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c455f1-7e5e-447c-a915-e7b0db91c829 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:22.345135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:22.345787 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.346068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.346351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.357623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:22.359074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:22.371428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1142/2244] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:27.846393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d65c8-e986-4332-a5f5-facfdafec898 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:27.846903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d65c8-e986-4332-a5f5-facfdafec898 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:27.846903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d65c8-e986-4332-a5f5-facfdafec898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:27.868967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e47d65c8-e986-4332-a5f5-facfdafec898 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:27.871031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e47d65c8-e986-4332-a5f5-facfdafec898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:27.880209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1103/2245] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:27.893331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:27.905382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6975460-1874-4d31-82b2-b07f839146ad service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:27.911121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:27.911850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:27.912233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:27.912609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:27.922030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:27.924484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:27.933696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1143/2246] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 14:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:58:58.192680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe9c2d-7d79-481a-83d3-2e171de22113 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:58.193309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe9c2d-7d79-481a-83d3-2e171de22113 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:58.193309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe9c2d-7d79-481a-83d3-2e171de22113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:58.211610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3efe9c2d-7d79-481a-83d3-2e171de22113 None None] MFA Rules not processed for user `08b114f5b57146d8b4324231982ce7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:58.212861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3efe9c2d-7d79-481a-83d3-2e171de22113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:58.275044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1104/2247] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 14:58:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:59:01.307119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:01.319743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ff2b-eaac-48ed-8281-89fc51415d58 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:01.324067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67974bda-6c67-4ec4-a879-302773ac7259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:01.324804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974bda-6c67-4ec4-a879-302773ac7259 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:01.325151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974bda-6c67-4ec4-a879-302773ac7259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:01.325490 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974bda-6c67-4ec4-a879-302773ac7259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:01.327482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-67974bda-6c67-4ec4-a879-302773ac7259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:01.340793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe9c2d-7d79-481a-83d3-2e171de22113 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:01.342091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67974bda-6c67-4ec4-a879-302773ac7259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:01.343576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67974bda-6c67-4ec4-a879-302773ac7259 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:01.353259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe9c2d-7d79-481a-83d3-2e171de22113 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:01.355457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1144/2248] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:59:01.357419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:01.358128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:01.358411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:01.358688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:01.360565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:01.374806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:01.376352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:01.387797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1105/2249] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:59:03.290192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:03.290780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:03.290780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:03.312594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:03.313991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:03.322520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1145/2250] 10.222.0.99 () {58 vars in 967 bytes} [Fri May 13 14:59:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:59:03.347743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:03.360112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0022c-80aa-4dff-925b-7654b4ae7ef3 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:03.365178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:03.365819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:03.366102 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:03.366375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:03.374994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:03.376660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:03.385218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1106/2251] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 14:59:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:59:32.265279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:32.267420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:32.288688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bfdf6-5f31-4b13-8c79-1e01550c356b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:32.295503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:32.296176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:32.296453 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:32.296735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:32.298825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:32.364958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:32.366593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:32.375794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1146/2252] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:59:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:59:42.832981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:42.843857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2d044-8913-4324-b618-d2f0ccc0094f service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:42.848233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:42.849001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:42.849158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:42.849679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:42.852155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:42.863695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:42.865198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:42.874781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1107/2253] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:59:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:59:46.319851 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:46.321769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:46.339830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b7fc4-b791-4699-a175-48b466bda41a service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:46.346982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82e98e-d617-4d2b-8c44-7bd3ce6ba10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:46.347828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e98e-d617-4d2b-8c44-7bd3ce6ba10b service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:46.348155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e98e-d617-4d2b-8c44-7bd3ce6ba10b service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:46.348434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e98e-d617-4d2b-8c44-7bd3ce6ba10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:46.350304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5c82e98e-d617-4d2b-8c44-7bd3ce6ba10b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:46.366007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e98e-d617-4d2b-8c44-7bd3ce6ba10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:46.367724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e98e-d617-4d2b-8c44-7bd3ce6ba10b service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:46.381908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1147/2254] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 14:59:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:00:05.667997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:05.680921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28bffa-b7a3-4bfd-a5fd-29ceda41b2fc service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:05.687453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:05.688153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:05.688428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:05.688700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:05.690673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:05.757121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:05.758765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:05.768904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1108/2255] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:00:08.943741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:08.944280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:08.944431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:08.965223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] MFA Rules not processed for user `18907451ac014573ba51f5f5f3939381`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:00:08.966865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:08.975479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1148/2256] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:00:09.349552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:09.363898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2bf9-b67d-4830-874e-9558ad2abd72 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:09.369707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:09.370357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:09.370638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:09.370911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:09.372741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:09.383380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:09.385112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:09.394138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1109/2257] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:00:15.380359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:15.381862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:15.450773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804e65a-b140-4801-a3c5-bb29aa4c28fd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:15.456440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:15.457331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:15.457607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:15.457877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] PATH_INFO: `/v3/users/08b114f5b57146d8b4324231982ce7d4` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:15.459068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b114f5b57146d8b4324231982ce7d4)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:15.461055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:15.520408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b114f5b57146d8b4324231982ce7d4'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:15.529329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b114f5b57146d8b4324231982ce7d4'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:15.542365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b114f5b57146d8b4324231982ce7d4'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:15.549570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b114f5b57146d8b4324231982ce7d4'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:15.550334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b114f5b57146d8b4324231982ce7d4'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:15.560731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1149/2258] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:00:15 2022] DELETE /identity/v3/users/08b114f5b57146d8b4324231982ce7d4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:00:15.892745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:15.913737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730bf7-9c0e-42f9-a9ea-c847b48150cb service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:15.995164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:15.996184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:15.996538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:15.996879 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] PATH_INFO: `/v3/projects/9cf795995a52452f93da8f04eb878e7b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:15.998462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf795995a52452f93da8f04eb878e7b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:16.000501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:16.052219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf795995a52452f93da8f04eb878e7b', 'request_id': 'req-a3164a47-4568-4cf2-8085-d16a71f3dbba'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:16.058694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf795995a52452f93da8f04eb878e7b', 'request_id': 'req-a3164a47-4568-4cf2-8085-d16a71f3dbba'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:16.067543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf795995a52452f93da8f04eb878e7b', 'request_id': 'req-a3164a47-4568-4cf2-8085-d16a71f3dbba'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:16.083512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] The token cache is being invalidate because project 9cf795995a52452f93da8f04eb878e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:00:16.083851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:16.084734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a3164a47-4568-4cf2-8085-d16a71f3dbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:00:16.099903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1110/2259] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:00:15 2022] DELETE /identity/v3/projects/9cf795995a52452f93da8f04eb878e7b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:00:16.983169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:16.985526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:17.059343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910cf24-e538-492c-bf03-4479952a6f84 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:17.120503 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:17.121171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:17.121437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:17.121737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:17.123620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:17.135835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:17.137463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:17.147895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1150/2260] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:00:23.901325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:23.901854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:23.901958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:23.920956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] MFA Rules not processed for user `1ded6e90b10949dcb921119073f2d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:00:23.922186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:23.978067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1111/2261] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:00:24.304925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:24.306727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:24.365555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792870a-7d2f-472d-9efb-ab66044edeef service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:24.369653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:24.370295 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:24.370573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:24.370847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:24.372660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:24.382287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:24.383743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:24.391760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1151/2262] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:00:24.740626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:24.742276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:24.817578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc49dc-1f15-4cff-8624-b6e11667f925 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:24.823246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:24.823906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:24.824223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:24.824495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:24.826339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:24.839599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:24.842131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:24.856396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1112/2263] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:00:34.104102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:34.105882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:34.123340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd7ac3-09c0-4350-b876-a4ad8ba475d3 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:34.129553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3569a-68e0-4c6f-9a98-f90d785f1e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:34.130241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3569a-68e0-4c6f-9a98-f90d785f1e3b service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:34.130528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3569a-68e0-4c6f-9a98-f90d785f1e3b service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:34.130804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3569a-68e0-4c6f-9a98-f90d785f1e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:34.132879 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-08f3569a-68e0-4c6f-9a98-f90d785f1e3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:34.146066 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3569a-68e0-4c6f-9a98-f90d785f1e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:34.147678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3569a-68e0-4c6f-9a98-f90d785f1e3b service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:34.159219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1152/2264] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:00:35.321247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:35.336559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19639fc4-32c4-42f1-ad97-1f0da201374b service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:35.344861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:35.345801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:35.346198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:35.346566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:35.349354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:35.415634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:35.417212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:35.427027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1113/2265] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:00:45.090934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40640b7-144d-4b88-ab3d-3886ec7b81c8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:45.091482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40640b7-144d-4b88-ab3d-3886ec7b81c8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:45.091585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40640b7-144d-4b88-ab3d-3886ec7b81c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:45.110408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a40640b7-144d-4b88-ab3d-3886ec7b81c8 None None] MFA Rules not processed for user `ac89928ac188406d910838be33a61c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:00:45.111676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a40640b7-144d-4b88-ab3d-3886ec7b81c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:45.119976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1153/2266] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:00:45.463384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:00:45.475171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6145a-6aad-41be-a060-b89c3b2dc3d7 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:00:45.479731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:00:45.480739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:00:45.481014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:00:45.481283 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:00:45.483354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:00:45.493519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:00:45.494956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:00:45.503290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1114/2267] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:01:31.975536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40640b7-144d-4b88-ab3d-3886ec7b81c8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:31.986676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40640b7-144d-4b88-ab3d-3886ec7b81c8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:31.992628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:31.993403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:31.993750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:31.994090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:31.997003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:32.068177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:32.069666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:32.079938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1154/2268] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:01:35.883711 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.885914 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:35.903396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64653338-6af9-4e7b-afda-5896830a219d service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.909331 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.910446 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.910852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.911327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] PATH_INFO: `/v3/users/18907451ac014573ba51f5f5f3939381` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.912628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18907451ac014573ba51f5f5f3939381)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.914567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.963205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18907451ac014573ba51f5f5f3939381'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:35.970667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18907451ac014573ba51f5f5f3939381'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:35.971416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18907451ac014573ba51f5f5f3939381'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:35.983909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18907451ac014573ba51f5f5f3939381'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:35.984581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-496a7b8d-5841-4f21-a45d-5e60e7db7ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18907451ac014573ba51f5f5f3939381'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.003602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1115/2269] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:01:35 2022] DELETE /identity/v3/users/18907451ac014573ba51f5f5f3939381 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:36.181286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.191910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40110584-7f01-4283-be62-abc708dda612 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.259515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.260506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.260789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.261067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] PATH_INFO: `/v3/projects/55a6554838094ba8a8b807bd90ec5bf4` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.262492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a6554838094ba8a8b807bd90ec5bf4)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.264683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.310383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a6554838094ba8a8b807bd90ec5bf4', 'request_id': 'req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.317065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a6554838094ba8a8b807bd90ec5bf4', 'request_id': 'req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.327112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a6554838094ba8a8b807bd90ec5bf4', 'request_id': 'req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.337928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] The token cache is being invalidate because project 55a6554838094ba8a8b807bd90ec5bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:01:36.338220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.338961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b4045c1-21b2-43a5-8a83-799d2aa34a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.340665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1155/2270] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:01:36 2022] DELETE /identity/v3/projects/55a6554838094ba8a8b807bd90ec5bf4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:36.345934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178f364-a67f-4c70-ae87-fc04cfd6c700 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.346321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178f364-a67f-4c70-ae87-fc04cfd6c700 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.346604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178f364-a67f-4c70-ae87-fc04cfd6c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.364563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5178f364-a67f-4c70-ae87-fc04cfd6c700 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:36.365848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5178f364-a67f-4c70-ae87-fc04cfd6c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:36.430601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1116/2271] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:36.438241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278946d-efc3-4afe-9b38-ee09e56286f0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.438802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278946d-efc3-4afe-9b38-ee09e56286f0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.439080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278946d-efc3-4afe-9b38-ee09e56286f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.459783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6278946d-efc3-4afe-9b38-ee09e56286f0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:36.461986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6278946d-efc3-4afe-9b38-ee09e56286f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:36.478659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1156/2272] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:36.484303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178f364-a67f-4c70-ae87-fc04cfd6c700 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.495226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178f364-a67f-4c70-ae87-fc04cfd6c700 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.500187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.501239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.501960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.502407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.503382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:01:36.503892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.505630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.520268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1117/2273] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:01:36.525207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278946d-efc3-4afe-9b38-ee09e56286f0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.537125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278946d-efc3-4afe-9b38-ee09e56286f0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.541814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.542514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.542797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.543199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.543938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.545934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.583806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1157/2274] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:01:36 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:36.588117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.598238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d6b2-9244-460f-a008-8b0c74ae3685 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.652225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.652921 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.653199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.653471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.654154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.656112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.677860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1118/2275] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:01:36 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:36.682068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.692733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7606c-2b64-4d10-86c0-b1906d17da6c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.697815 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.698486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.698774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.699049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.699783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.701432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.711644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1158/2276] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:36.715511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.726032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6837b03-1ce3-4e7b-aff6-0b5e34341046 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.731221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486234-9e82-4b85-8e5e-4f289139fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.731910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486234-9e82-4b85-8e5e-4f289139fe9d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.732198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486234-9e82-4b85-8e5e-4f289139fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.732474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486234-9e82-4b85-8e5e-4f289139fe9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.733211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486234-9e82-4b85-8e5e-4f289139fe9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.734974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486234-9e82-4b85-8e5e-4f289139fe9d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.746342 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1119/2277] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:36.750329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.761086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e24ba-e98b-43c4-b187-835e8ebcbd74 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.766488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.767646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.767959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.768239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] PATH_INFO: `/v3/projects/3fb11cf0a7744bd2ad48fd859e55ab9b/users/386413aeb9a344a58e49b396e24d234c/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.785057 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb11cf0a7744bd2ad48fd859e55ab9b, user_id=386413aeb9a344a58e49b396e24d234c, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.787768 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.802375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1159/2278] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:01:36 2022] PUT /identity/v3/projects/3fb11cf0a7744bd2ad48fd859e55ab9b/users/386413aeb9a344a58e49b396e24d234c/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:36.812405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af7e9-78a4-4f67-aef5-72c930f83e0e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.812718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af7e9-78a4-4f67-aef5-72c930f83e0e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.812976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af7e9-78a4-4f67-aef5-72c930f83e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.843707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ec6af7e9-78a4-4f67-aef5-72c930f83e0e None None] MFA Rules not processed for user `386413aeb9a344a58e49b396e24d234c`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:36.845039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ec6af7e9-78a4-4f67-aef5-72c930f83e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:36.914443 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1120/2279] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:36.919141 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.982898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ccf54-de82-4c7f-85a9-6770f7b64531 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.988699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31053b-d334-4421-b49a-a547de162ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.989506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31053b-d334-4421-b49a-a547de162ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.989800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31053b-d334-4421-b49a-a547de162ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.990104 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31053b-d334-4421-b49a-a547de162ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.990902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31053b-d334-4421-b49a-a547de162ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.992836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31053b-d334-4421-b49a-a547de162ffc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.022136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1160/2280] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:01:36 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:37.031476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6af7e9-78a4-4f67-aef5-72c930f83e0e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:37.043761 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6af7e9-78a4-4f67-aef5-72c930f83e0e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:37.089417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c191-2d3b-4a6d-92fd-ed80c8522042 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.089709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c191-2d3b-4a6d-92fd-ed80c8522042 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.090016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c191-2d3b-4a6d-92fd-ed80c8522042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.104059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:37.105024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.105306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.105580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.106261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:37.108248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.109644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cc45c191-2d3b-4a6d-92fd-ed80c8522042 None None] MFA Rules not processed for user `fbe6cc242fbf40cf8250dabaa336f648`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:37.111241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cc45c191-2d3b-4a6d-92fd-ed80c8522042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:37.132445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1121/2281] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:01:37 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:37.133472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:37.143263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310392-396e-4430-890d-a4c0c165ccde admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:37.147967 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:37.148618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.148899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.149173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.149894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:37.151534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.161536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1122/2282] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:37.165679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:37.165825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1161/2283] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:01:37.175622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956287-d3cd-46fc-94fd-7dbd5dd91ed0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:37.180219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:37.181094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.181380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.181656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] PATH_INFO: `/v3/projects/01aa48fd94cc417aa51457af17d6dcb6/users/e4ecc72d1d334298a6559364130d815c/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.196723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01aa48fd94cc417aa51457af17d6dcb6, user_id=e4ecc72d1d334298a6559364130d815c, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:37.199405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.213763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1123/2284] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:01:37 2022] PUT /identity/v3/projects/01aa48fd94cc417aa51457af17d6dcb6/users/e4ecc72d1d334298a6559364130d815c/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:01:37.218569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45c191-2d3b-4a6d-92fd-ed80c8522042 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:37.229480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45c191-2d3b-4a6d-92fd-ed80c8522042 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:37.286625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2186c4-a369-44c6-b1fd-24fe6fcee008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:37.287289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2186c4-a369-44c6-b1fd-24fe6fcee008 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.287567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2186c4-a369-44c6-b1fd-24fe6fcee008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.287836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2186c4-a369-44c6-b1fd-24fe6fcee008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.288596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2186c4-a369-44c6-b1fd-24fe6fcee008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:37.290224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2186c4-a369-44c6-b1fd-24fe6fcee008 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.300236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1162/2285] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:37.304641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:37.315460 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c409f4-e662-455b-b28d-c340e2d10626 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:37.320323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:37.321202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.321481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.321882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] PATH_INFO: `/v3/projects/01aa48fd94cc417aa51457af17d6dcb6/users/e4ecc72d1d334298a6559364130d815c/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.323893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01aa48fd94cc417aa51457af17d6dcb6, user_id=e4ecc72d1d334298a6559364130d815c, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:37.326611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.337192 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1124/2286] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:01:37 2022] PUT /identity/v3/projects/01aa48fd94cc417aa51457af17d6dcb6/users/e4ecc72d1d334298a6559364130d815c/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:37.348573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711db6-9c70-4cd4-aedc-7ad832f6125a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.348858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711db6-9c70-4cd4-aedc-7ad832f6125a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.349146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711db6-9c70-4cd4-aedc-7ad832f6125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.375462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ef711db6-9c70-4cd4-aedc-7ad832f6125a None None] MFA Rules not processed for user `e4ecc72d1d334298a6559364130d815c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:37.376747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ef711db6-9c70-4cd4-aedc-7ad832f6125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:37.460917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1163/2287] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:37.472706 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:37.474759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:37.532523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93b401-8991-4a37-8ac8-b73333a35106 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:37.536297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:37.536951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.537230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.537506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.547075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:37.548625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.558792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1125/2288] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:01:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:01:37.637029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711db6-9c70-4cd4-aedc-7ad832f6125a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:37.646886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711db6-9c70-4cd4-aedc-7ad832f6125a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:37.650740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599ae6-1f3d-4e9b-bcd6-2dfe5cc66640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:37.651411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599ae6-1f3d-4e9b-bcd6-2dfe5cc66640 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:37.651665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599ae6-1f3d-4e9b-bcd6-2dfe5cc66640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:37.651973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599ae6-1f3d-4e9b-bcd6-2dfe5cc66640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:37.709006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599ae6-1f3d-4e9b-bcd6-2dfe5cc66640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:37.710606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599ae6-1f3d-4e9b-bcd6-2dfe5cc66640 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.720247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1164/2289] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:01:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:01:40.503931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:40.567230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d7d47-349a-4f7f-a21d-250e7c98e615 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:40.571835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:40.572742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:40.573025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:40.573301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] PATH_INFO: `/v3/users/386413aeb9a344a58e49b396e24d234c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:40.574530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=386413aeb9a344a58e49b396e24d234c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:40.576517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:40.627779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386413aeb9a344a58e49b396e24d234c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:40.634815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386413aeb9a344a58e49b396e24d234c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:40.635525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386413aeb9a344a58e49b396e24d234c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:40.647402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386413aeb9a344a58e49b396e24d234c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:40.648129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386413aeb9a344a58e49b396e24d234c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:40.664577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1126/2290] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:01:40 2022] DELETE /identity/v3/users/386413aeb9a344a58e49b396e24d234c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:40.669203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:40.669705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:40.669801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:40.686495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:40.687807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:40.751456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1165/2291] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:40.761122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:40.762667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:40.820899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07ff9-29c1-49e0-8422-3483ca5f59d5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:40.825238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:40.825895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:40.826171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:40.826438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:40.836567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:40.838018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:40.847498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1127/2292] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:01:41.126436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:41.128087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:41.140275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de57ec-bf82-4a8f-acf0-a87d351aca5c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:41.145749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:41.146633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:41.146917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:41.147212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] PATH_INFO: `/v3/projects/3fb11cf0a7744bd2ad48fd859e55ab9b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:41.148508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb11cf0a7744bd2ad48fd859e55ab9b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:41.150463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:41.200020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb11cf0a7744bd2ad48fd859e55ab9b', 'request_id': 'req-6ec85ea7-0259-4fa7-9753-7f0679b091e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.206848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb11cf0a7744bd2ad48fd859e55ab9b', 'request_id': 'req-6ec85ea7-0259-4fa7-9753-7f0679b091e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.216134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb11cf0a7744bd2ad48fd859e55ab9b', 'request_id': 'req-6ec85ea7-0259-4fa7-9753-7f0679b091e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.227309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] The token cache is being invalidate because project 3fb11cf0a7744bd2ad48fd859e55ab9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:01:41.227600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.228272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.230254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1166/2293] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:01:41 2022] DELETE /identity/v3/projects/3fb11cf0a7744bd2ad48fd859e55ab9b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:41.234350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:41.245690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fcc5-607c-47a1-ace4-d4b7c22d5b9e service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:41.301656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:41.302558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:41.302847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:41.303128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] PATH_INFO: `/v3/users/e4ecc72d1d334298a6559364130d815c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:41.304386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ecc72d1d334298a6559364130d815c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:41.306326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:41.354945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ecc72d1d334298a6559364130d815c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.364361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ecc72d1d334298a6559364130d815c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.365230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ecc72d1d334298a6559364130d815c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.379015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ecc72d1d334298a6559364130d815c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.379719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aacd15b7-7d19-49fa-993a-3369776d3d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ecc72d1d334298a6559364130d815c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.396587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1128/2294] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:01:41 2022] DELETE /identity/v3/users/e4ecc72d1d334298a6559364130d815c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:41.684022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:41.685512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:41.699706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85ea7-0259-4fa7-9753-7f0679b091e7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:41.762831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:41.763708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:41.764034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:41.764308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] PATH_INFO: `/v3/projects/01aa48fd94cc417aa51457af17d6dcb6` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:41.765621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01aa48fd94cc417aa51457af17d6dcb6)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:41.767553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:41.823854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01aa48fd94cc417aa51457af17d6dcb6', 'request_id': 'req-20e2c60e-903f-4089-9bc9-e8f69252a19d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.829897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01aa48fd94cc417aa51457af17d6dcb6', 'request_id': 'req-20e2c60e-903f-4089-9bc9-e8f69252a19d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.839042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01aa48fd94cc417aa51457af17d6dcb6', 'request_id': 'req-20e2c60e-903f-4089-9bc9-e8f69252a19d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.849538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] The token cache is being invalidate because project 01aa48fd94cc417aa51457af17d6dcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:01:41.849824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.850452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20e2c60e-903f-4089-9bc9-e8f69252a19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:41.852068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1167/2295] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:01:41 2022] DELETE /identity/v3/projects/01aa48fd94cc417aa51457af17d6dcb6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:41.857497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a3bd2-ebf3-46ac-9d45-250501acff4e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:41.858018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a3bd2-ebf3-46ac-9d45-250501acff4e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:41.858018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a3bd2-ebf3-46ac-9d45-250501acff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:41.875660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c94a3bd2-ebf3-46ac-9d45-250501acff4e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:41.876955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c94a3bd2-ebf3-46ac-9d45-250501acff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:41.939106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1129/2296] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:41.947231 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4a418-8d02-4ee1-b2b8-0cdb0fd14081 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:41.947522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4a418-8d02-4ee1-b2b8-0cdb0fd14081 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:41.947790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4a418-8d02-4ee1-b2b8-0cdb0fd14081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:41.967346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e1f4a418-8d02-4ee1-b2b8-0cdb0fd14081 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:41.968599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e1f4a418-8d02-4ee1-b2b8-0cdb0fd14081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:41.978074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1168/2297] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:41.982802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a3bd2-ebf3-46ac-9d45-250501acff4e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:41.993958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a3bd2-ebf3-46ac-9d45-250501acff4e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:41.999558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.000284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.000563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.000844 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.001600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:01:42.002073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.003542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.015357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1130/2298] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:01:42.020167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4a418-8d02-4ee1-b2b8-0cdb0fd14081 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.029377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4a418-8d02-4ee1-b2b8-0cdb0fd14081 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.034938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.035589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.035892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.036181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.036878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.038777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.068367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1169/2299] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:01:42 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:42.074993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.088293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffbcbc-15a8-45de-9934-6c88c07bd1c2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.152317 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.152760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.153053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.153329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.154020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.156048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.180275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1131/2300] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:01:42 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:42.184588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.195431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c59f59-fc31-40b3-b121-6e19436bed2a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.200432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.201096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.201381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.201662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.202399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.204050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.214543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1170/2301] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:42.218664 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.229606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931dc8d-40e2-4a66-891b-e2d5e8a6d3c8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.235353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a9456-f6fa-491a-b2bb-f5f35424a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.236059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a9456-f6fa-491a-b2bb-f5f35424a5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.236339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a9456-f6fa-491a-b2bb-f5f35424a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.236609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a9456-f6fa-491a-b2bb-f5f35424a5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.237369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a9456-f6fa-491a-b2bb-f5f35424a5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.239053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a9456-f6fa-491a-b2bb-f5f35424a5f4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.249272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1132/2302] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:42.253505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.263644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116c086-27e2-4e45-b8e6-bd7335823c35 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.268855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.269835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.270143 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.270421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] PATH_INFO: `/v3/projects/8fa50f5798df4a28a6ab5341792806ed/users/8c57f2a2bba54455ba7aa3d358fe0646/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.287501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa50f5798df4a28a6ab5341792806ed, user_id=8c57f2a2bba54455ba7aa3d358fe0646, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.290211 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.306569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1171/2303] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:01:42 2022] PUT /identity/v3/projects/8fa50f5798df4a28a6ab5341792806ed/users/8c57f2a2bba54455ba7aa3d358fe0646/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:42.317999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e4ec-ab93-40a6-9a65-3047a4668985 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.318286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e4ec-ab93-40a6-9a65-3047a4668985 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.318560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6e4ec-ab93-40a6-9a65-3047a4668985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.346905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-eeb6e4ec-ab93-40a6-9a65-3047a4668985 None None] MFA Rules not processed for user `8c57f2a2bba54455ba7aa3d358fe0646`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:42.348470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eeb6e4ec-ab93-40a6-9a65-3047a4668985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:42.412642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1133/2304] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:42.417176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.495780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c23b92-6a9e-446e-95bf-bcc60e6bcb3e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.500775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.501448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.501735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.502014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.502729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.505397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.536515 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1172/2305] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:01:42 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:42.540670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6e4ec-ab93-40a6-9a65-3047a4668985 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.551906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6e4ec-ab93-40a6-9a65-3047a4668985 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.609923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.610477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.610792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.611068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.611774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.614401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.637077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1134/2306] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:01:42 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:01:42.641152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.651573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e81f-a73d-48f1-945c-6828d0c7c739 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.657470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.658128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.658408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.659045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.659784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.661517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.672300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1173/2307] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:42.676866 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.687073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da12b7-1aa5-430a-b471-68c188ec8a49 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.692558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.693437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.693712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.693982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] PATH_INFO: `/v3/projects/790b938fc22343d5bef8f78ba35a224b/users/a0a69f97fdbc47f18293ff190a1169f7/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.709202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=790b938fc22343d5bef8f78ba35a224b, user_id=a0a69f97fdbc47f18293ff190a1169f7, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.711900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.726908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1135/2308] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:01:42 2022] PUT /identity/v3/projects/790b938fc22343d5bef8f78ba35a224b/users/a0a69f97fdbc47f18293ff190a1169f7/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:42.731359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.741599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d5ed3-6a18-4b76-a93c-75b7af863cd2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.799923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbe8b0-67ee-4741-8df5-58ae045bc1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.800723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbe8b0-67ee-4741-8df5-58ae045bc1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.801199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbe8b0-67ee-4741-8df5-58ae045bc1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.801487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbe8b0-67ee-4741-8df5-58ae045bc1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.802213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbe8b0-67ee-4741-8df5-58ae045bc1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.803822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbe8b0-67ee-4741-8df5-58ae045bc1b2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.816982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1174/2309] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:01:42.823217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.837136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d65d9-557e-4139-8800-619070173cce admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:42.843042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:42.843955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.844236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.844507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] PATH_INFO: `/v3/projects/790b938fc22343d5bef8f78ba35a224b/users/a0a69f97fdbc47f18293ff190a1169f7/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.846746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=790b938fc22343d5bef8f78ba35a224b, user_id=a0a69f97fdbc47f18293ff190a1169f7, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:42.849517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:42.860496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1136/2310] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:01:42 2022] PUT /identity/v3/projects/790b938fc22343d5bef8f78ba35a224b/users/a0a69f97fdbc47f18293ff190a1169f7/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:42.870891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846ca0-df5e-4481-a0be-57e260142fbe None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:42.871206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846ca0-df5e-4481-a0be-57e260142fbe None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:42.871479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846ca0-df5e-4481-a0be-57e260142fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:42.899978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-75846ca0-df5e-4481-a0be-57e260142fbe None None] MFA Rules not processed for user `a0a69f97fdbc47f18293ff190a1169f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:42.901198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-75846ca0-df5e-4481-a0be-57e260142fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:42.973970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1175/2311] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:42.988867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:42.990937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:43.051887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8401-7597-4330-bac7-b6934d1530bf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:43.056607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:43.057254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:43.057507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:43.057774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:43.121421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:43.122810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:43.132089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1137/2312] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:01:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:01:49.844596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846ca0-df5e-4481-a0be-57e260142fbe None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:49.855284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846ca0-df5e-4481-a0be-57e260142fbe None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:49.859207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:49.859886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:49.860178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:49.860455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:49.871504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:49.873049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:49.883832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1176/2313] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:01:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:09.729006 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:09.730632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:09.804530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7316d-e610-4886-bc8d-6b2d8170dd12 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:09.810293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446336-8eef-43df-98ad-894e9bd839e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:09.810950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446336-8eef-43df-98ad-894e9bd839e2 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:09.811690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446336-8eef-43df-98ad-894e9bd839e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:09.811690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446336-8eef-43df-98ad-894e9bd839e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:09.813753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-61446336-8eef-43df-98ad-894e9bd839e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:09.825528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61446336-8eef-43df-98ad-894e9bd839e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:09.827161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61446336-8eef-43df-98ad-894e9bd839e2 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:09.838036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1138/2314] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:21.088126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:21.151955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1bf3-1fb8-4b0a-8d0b-badf411817f7 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:21.157238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:21.158091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:21.158374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:21.158652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] PATH_INFO: `/v3/users/8c57f2a2bba54455ba7aa3d358fe0646` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:21.159938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c57f2a2bba54455ba7aa3d358fe0646)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:21.162154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:21.216879 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c57f2a2bba54455ba7aa3d358fe0646'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.227657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c57f2a2bba54455ba7aa3d358fe0646'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.242556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c57f2a2bba54455ba7aa3d358fe0646'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.249880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c57f2a2bba54455ba7aa3d358fe0646'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.250732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c57f2a2bba54455ba7aa3d358fe0646'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.258318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1177/2315] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:21 2022] DELETE /identity/v3/users/8c57f2a2bba54455ba7aa3d358fe0646 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:21.263933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:21.264469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:21.264469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:21.284266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:21.285470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:21.345978 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1139/2316] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:21.356498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:21.358135 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:21.419552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac6d7-08ef-4c8b-b65d-99efdb45ca3b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:21.423438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:21.424133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:21.424423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:21.424705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:21.434867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:21.436361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:21.446424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1178/2317] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:21.745195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:21.746943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:21.759337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d631a64-e60d-4ba8-83e1-adcbba3ed3a0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:21.764165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:21.765062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:21.765340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:21.765611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] PATH_INFO: `/v3/projects/8fa50f5798df4a28a6ab5341792806ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:21.766806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa50f5798df4a28a6ab5341792806ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:21.768934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:21.816851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa50f5798df4a28a6ab5341792806ed', 'request_id': 'req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.822953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa50f5798df4a28a6ab5341792806ed', 'request_id': 'req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.841362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa50f5798df4a28a6ab5341792806ed', 'request_id': 'req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.858738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] The token cache is being invalidate because project 8fa50f5798df4a28a6ab5341792806ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:21.859126 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.860099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:21.862445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1140/2318] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:21 2022] DELETE /identity/v3/projects/8fa50f5798df4a28a6ab5341792806ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:21.867178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:21.879459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c472c2-2824-476c-84a8-15ad18e833d9 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:21.936180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:21.937082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:21.937396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:21.937706 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] PATH_INFO: `/v3/users/a0a69f97fdbc47f18293ff190a1169f7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:21.938985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a69f97fdbc47f18293ff190a1169f7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:21.940947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:21.993562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a69f97fdbc47f18293ff190a1169f7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.002251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a69f97fdbc47f18293ff190a1169f7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.014920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a69f97fdbc47f18293ff190a1169f7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.021594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a69f97fdbc47f18293ff190a1169f7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.022253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-11c51d9d-1138-41cb-9e14-e8190a247b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a69f97fdbc47f18293ff190a1169f7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.028320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1179/2319] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:21 2022] DELETE /identity/v3/users/a0a69f97fdbc47f18293ff190a1169f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:22.308074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:22.309643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:22.322751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a5712-a84b-4ad6-8e8e-2dbb4115a1ce admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:22.387718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:22.388612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.388897 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.389173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] PATH_INFO: `/v3/projects/790b938fc22343d5bef8f78ba35a224b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.390356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790b938fc22343d5bef8f78ba35a224b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:22.392841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:22.442260 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790b938fc22343d5bef8f78ba35a224b', 'request_id': 'req-98b51406-72a6-46c5-a9c3-edba4cb28d95'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.449070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790b938fc22343d5bef8f78ba35a224b', 'request_id': 'req-98b51406-72a6-46c5-a9c3-edba4cb28d95'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.458086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790b938fc22343d5bef8f78ba35a224b', 'request_id': 'req-98b51406-72a6-46c5-a9c3-edba4cb28d95'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.468052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] The token cache is being invalidate because project 790b938fc22343d5bef8f78ba35a224b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:22.468336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.468964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-98b51406-72a6-46c5-a9c3-edba4cb28d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:22.470531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1141/2320] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:22 2022] DELETE /identity/v3/projects/790b938fc22343d5bef8f78ba35a224b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:22.476321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8bf01-af4b-4211-b674-52f4df7a37a4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.476806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8bf01-af4b-4211-b674-52f4df7a37a4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.476806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8bf01-af4b-4211-b674-52f4df7a37a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.496117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1bb8bf01-af4b-4211-b674-52f4df7a37a4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:22.497333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1bb8bf01-af4b-4211-b674-52f4df7a37a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:22.570456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1180/2321] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:22.578674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c5612-a8e1-48d6-b23b-3f77af9d0346 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.578964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c5612-a8e1-48d6-b23b-3f77af9d0346 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.579239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c5612-a8e1-48d6-b23b-3f77af9d0346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.599236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-166c5612-a8e1-48d6-b23b-3f77af9d0346 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:22.600608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-166c5612-a8e1-48d6-b23b-3f77af9d0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:22.609996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1142/2322] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:22.614824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8bf01-af4b-4211-b674-52f4df7a37a4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:22.625054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8bf01-af4b-4211-b674-52f4df7a37a4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:22.630843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:22.631480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.631762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.632078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.632811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:02:22.633118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:22.634690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:22.646837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1181/2323] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:02:22.651379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c5612-a8e1-48d6-b23b-3f77af9d0346 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:22.661075 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c5612-a8e1-48d6-b23b-3f77af9d0346 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:22.666712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:22.667375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.667632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.667930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.668630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:22.670556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:22.703069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1143/2324] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:02:22 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:22.709869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:22.720025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5c6ed-85ba-4eed-bb65-cf2b62656cea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:22.780811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:22.781405 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.781686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.781957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.782676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:22.784650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:22.811435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1182/2325] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:02:22 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:22.812991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:22.823605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2c589-a6b8-41f7-a562-2b41c1d5035e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:22.829717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:22.830381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.830665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.830940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.831665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:22.833380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:22.844449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1144/2326] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:22.848692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:22.859512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240b97-9634-4b29-99be-5cd2587b2c70 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:22.865709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ba4d0-40d6-4e62-86af-4b20b91aa850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:22.866366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba4d0-40d6-4e62-86af-4b20b91aa850 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.866643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba4d0-40d6-4e62-86af-4b20b91aa850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.866910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba4d0-40d6-4e62-86af-4b20b91aa850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.867640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ba4d0-40d6-4e62-86af-4b20b91aa850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:22.869300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ba4d0-40d6-4e62-86af-4b20b91aa850 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:22.880089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1183/2327] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:22.884451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:22.894573 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba28183-d8e8-4ad7-808c-1aa75acada57 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:22.899480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:22.900400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.900683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.900983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] PATH_INFO: `/v3/projects/b2994c732df54656a01f014e5cf64293/users/3684e6b2d2a7423c8b392e0a1e696169/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.916430 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2994c732df54656a01f014e5cf64293, user_id=3684e6b2d2a7423c8b392e0a1e696169, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:22.919112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:22.938869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1145/2328] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:22 2022] PUT /identity/v3/projects/b2994c732df54656a01f014e5cf64293/users/3684e6b2d2a7423c8b392e0a1e696169/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:02:22.949240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95261a-f54f-4a18-9108-3d48bc76669d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:22.949553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95261a-f54f-4a18-9108-3d48bc76669d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:22.949825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95261a-f54f-4a18-9108-3d48bc76669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:22.976984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-dc95261a-f54f-4a18-9108-3d48bc76669d None None] MFA Rules not processed for user `3684e6b2d2a7423c8b392e0a1e696169`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:22.978535 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dc95261a-f54f-4a18-9108-3d48bc76669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:23.044695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1184/2329] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:23.049277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.110783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543d3fc-9d12-4dd4-9948-d3a605952a79 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.115624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.116322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.116596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.116865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.117537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.119450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.146474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1146/2330] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:02:23 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:23.150731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95261a-f54f-4a18-9108-3d48bc76669d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.161701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95261a-f54f-4a18-9108-3d48bc76669d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.218527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.219193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.219475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.219751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.220473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.222398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.244653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1185/2331] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:02:23 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:23.248608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.262165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb8e8-1f05-4630-93a1-29ae3ba4d156 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.270231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.270892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.271174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.271447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.272191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.273784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.284630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1147/2332] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:02:23.288840 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.298939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d767-1387-41cd-966d-4d39c0d10811 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.304154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.305098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.305383 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.305657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] PATH_INFO: `/v3/projects/4d5bf3d88df1413ea7bf72a10e656524/users/01f601f1a2c34e9c983030fd09070040/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.321428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5bf3d88df1413ea7bf72a10e656524, user_id=01f601f1a2c34e9c983030fd09070040, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.324133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.340492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1186/2333] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:23 2022] PUT /identity/v3/projects/4d5bf3d88df1413ea7bf72a10e656524/users/01f601f1a2c34e9c983030fd09070040/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:23.345892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.356827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34805ee-b920-4869-806b-25dfd1bd2af3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.420869 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d92786-60be-44e5-8911-7a616f32f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.421530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92786-60be-44e5-8911-7a616f32f069 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.421892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92786-60be-44e5-8911-7a616f32f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.422134 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92786-60be-44e5-8911-7a616f32f069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.422879 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d92786-60be-44e5-8911-7a616f32f069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.424520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d92786-60be-44e5-8911-7a616f32f069 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.434535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1148/2334] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:23.438886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.449561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc9c3f-74b3-4e30-9700-cef4db24f69c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.454511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.455396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.455681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.455976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] PATH_INFO: `/v3/projects/4d5bf3d88df1413ea7bf72a10e656524/users/01f601f1a2c34e9c983030fd09070040/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.458252 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5bf3d88df1413ea7bf72a10e656524, user_id=01f601f1a2c34e9c983030fd09070040, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.460904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.471187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1187/2335] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:23 2022] PUT /identity/v3/projects/4d5bf3d88df1413ea7bf72a10e656524/users/01f601f1a2c34e9c983030fd09070040/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:02:23.482031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.482321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.482599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.512295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] MFA Rules not processed for user `01f601f1a2c34e9c983030fd09070040`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:23.513524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:23.589421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1149/2336] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:23.603037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.605520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:23.670395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad1add-dc7f-4c78-921e-12c7e8b1328c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.675001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.675652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.676037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.676757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.686166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.687611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.697722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1188/2337] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:23.746195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:23.748089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:23.763108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bd6f6-bb09-4c64-9b21-eafbd524c212 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:23.768121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe2818-dc30-4c82-8731-69c01b4a9c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:23.769147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2818-dc30-4c82-8731-69c01b4a9c7b service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:23.769638 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2818-dc30-4c82-8731-69c01b4a9c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:23.770101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe2818-dc30-4c82-8731-69c01b4a9c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:23.843698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe2818-dc30-4c82-8731-69c01b4a9c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:23.845282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe2818-dc30-4c82-8731-69c01b4a9c7b service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:23.855623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1150/2338] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:27.197591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:27.269045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b43b-547e-4b88-b477-f84be79a771f service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:27.275540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:27.276459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:27.276739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:27.277014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] PATH_INFO: `/v3/users/3684e6b2d2a7423c8b392e0a1e696169` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:27.278396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3684e6b2d2a7423c8b392e0a1e696169)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:27.280391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:27.335968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3684e6b2d2a7423c8b392e0a1e696169'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.352454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3684e6b2d2a7423c8b392e0a1e696169'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.370905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3684e6b2d2a7423c8b392e0a1e696169'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.381635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3684e6b2d2a7423c8b392e0a1e696169'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.382348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3684e6b2d2a7423c8b392e0a1e696169'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.388616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1189/2339] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:27 2022] DELETE /identity/v3/users/3684e6b2d2a7423c8b392e0a1e696169 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:27.393220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:27.394061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:27.394342 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:27.412829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:27.414077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:27.475488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1151/2340] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:27.486391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:27.488316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:27.549025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322274-d754-4cca-9a5f-9d1eb489fed3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:27.553393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:27.554036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:27.554315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:27.554585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:27.563498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:27.565001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:27.574660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1190/2341] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:27.858614 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:27.860279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:27.880956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa4190-a7a8-408d-8105-103ef2ca615e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:27.888278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:27.889486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:27.889970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:27.890417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] PATH_INFO: `/v3/projects/b2994c732df54656a01f014e5cf64293` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:27.892021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2994c732df54656a01f014e5cf64293)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:27.894387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:27.951581 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2994c732df54656a01f014e5cf64293', 'request_id': 'req-da34e53b-9cc2-4784-af41-a12ea7dcefb7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.958226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2994c732df54656a01f014e5cf64293', 'request_id': 'req-da34e53b-9cc2-4784-af41-a12ea7dcefb7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.968852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2994c732df54656a01f014e5cf64293', 'request_id': 'req-da34e53b-9cc2-4784-af41-a12ea7dcefb7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.981771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] The token cache is being invalidate because project b2994c732df54656a01f014e5cf64293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:27.982061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.982740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:27.984382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1152/2342] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:27 2022] DELETE /identity/v3/projects/b2994c732df54656a01f014e5cf64293 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:27.990127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:28.006714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec20fdb-ceb5-438e-b9b3-273684b1a68e service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:28.064682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:28.065599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.065875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.066144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] PATH_INFO: `/v3/users/01f601f1a2c34e9c983030fd09070040` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.067307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f601f1a2c34e9c983030fd09070040)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:28.069442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:28.117185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f601f1a2c34e9c983030fd09070040'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.126741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f601f1a2c34e9c983030fd09070040'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.139145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f601f1a2c34e9c983030fd09070040'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.146157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f601f1a2c34e9c983030fd09070040'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.146884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f7ab497-89a9-4eb9-a983-a420bef2264c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f601f1a2c34e9c983030fd09070040'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.152830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1191/2343] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:27 2022] DELETE /identity/v3/users/01f601f1a2c34e9c983030fd09070040 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:28.430456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:28.432455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:28.447143 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34e53b-9cc2-4784-af41-a12ea7dcefb7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:28.505240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:28.506172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.506438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.506712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] PATH_INFO: `/v3/projects/4d5bf3d88df1413ea7bf72a10e656524` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.507972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5bf3d88df1413ea7bf72a10e656524)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:28.509889 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:28.562692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5bf3d88df1413ea7bf72a10e656524', 'request_id': 'req-6662ebf2-37a1-4f35-9f47-8451d7409ed2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.572413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5bf3d88df1413ea7bf72a10e656524', 'request_id': 'req-6662ebf2-37a1-4f35-9f47-8451d7409ed2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.582363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5bf3d88df1413ea7bf72a10e656524', 'request_id': 'req-6662ebf2-37a1-4f35-9f47-8451d7409ed2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.592871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] The token cache is being invalidate because project 4d5bf3d88df1413ea7bf72a10e656524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:28.593154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.593759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6662ebf2-37a1-4f35-9f47-8451d7409ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:28.595349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1153/2344] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:28 2022] DELETE /identity/v3/projects/4d5bf3d88df1413ea7bf72a10e656524 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:28.601570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8a94-b836-4559-8777-07b14536ac5f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.602085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8a94-b836-4559-8777-07b14536ac5f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.602085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8a94-b836-4559-8777-07b14536ac5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.621151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-85bf8a94-b836-4559-8777-07b14536ac5f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:28.622359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-85bf8a94-b836-4559-8777-07b14536ac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:28.686751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1192/2345] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:28.696105 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49423771-22c0-451d-b041-d631ac9f62df None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.696373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49423771-22c0-451d-b041-d631ac9f62df None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.696649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49423771-22c0-451d-b041-d631ac9f62df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.716476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-49423771-22c0-451d-b041-d631ac9f62df None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:28.717679 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-49423771-22c0-451d-b041-d631ac9f62df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:28.727044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1154/2346] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:28.731711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8a94-b836-4559-8777-07b14536ac5f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:28.742524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8a94-b836-4559-8777-07b14536ac5f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:28.748226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:28.748920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.749206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.749496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.750221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:02:28.750533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:28.752160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:28.765483 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1193/2347] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:02:28.772160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49423771-22c0-451d-b041-d631ac9f62df None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:28.786423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49423771-22c0-451d-b041-d631ac9f62df None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:28.795018 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:28.795992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.796397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.796784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.797815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:28.800731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:28.831012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1155/2348] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:02:28 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:28.837311 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:28.851947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182195b-c0d3-4966-a840-ac1197ed2d68 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:28.917651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:28.918324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.918601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.918870 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.919557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:28.921618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:28.945918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1194/2349] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:02:28 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:28.950081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:28.961351 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce170a5-dc7a-4b21-b35f-3efff4396b43 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:28.967032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:28.967732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:28.968053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:28.968335 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:28.969077 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:28.970702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:28.981777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1156/2350] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:28.986792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:28.997570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca2ed-b9fe-4d9a-bc06-88481325aee8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.002923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2cc90-2272-4243-b06c-bc24c286fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.003625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2cc90-2272-4243-b06c-bc24c286fe22 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.003936 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2cc90-2272-4243-b06c-bc24c286fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.004210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2cc90-2272-4243-b06c-bc24c286fe22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.004937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2cc90-2272-4243-b06c-bc24c286fe22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.006781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2cc90-2272-4243-b06c-bc24c286fe22 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.016843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1195/2351] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:29.021186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.032016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce992f1-7af5-452b-9680-a804115d8243 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.038177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.039099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.039388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.039663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] PATH_INFO: `/v3/projects/522877ce2c4847298517db2d53831268/users/8b8e72d4176f45129892b3c78cdca498/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.055277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522877ce2c4847298517db2d53831268, user_id=8b8e72d4176f45129892b3c78cdca498, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.057979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.074631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1157/2352] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:29 2022] PUT /identity/v3/projects/522877ce2c4847298517db2d53831268/users/8b8e72d4176f45129892b3c78cdca498/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:29.085472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b2354-fc7e-4b45-ac88-826d19c78931 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.085758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b2354-fc7e-4b45-ac88-826d19c78931 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.086049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b2354-fc7e-4b45-ac88-826d19c78931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.114598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8f1b2354-fc7e-4b45-ac88-826d19c78931 None None] MFA Rules not processed for user `8b8e72d4176f45129892b3c78cdca498`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:29.115766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8f1b2354-fc7e-4b45-ac88-826d19c78931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:29.180261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1196/2353] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:29.184999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.246296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9088b-e217-4536-b03c-b00e1f8be0b4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.251507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.252209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.252492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.252767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.253474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.255396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.281692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1158/2354] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:02:29 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:02:29.285960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b2354-fc7e-4b45-ac88-826d19c78931 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.296708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b2354-fc7e-4b45-ac88-826d19c78931 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.361123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.361786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.362068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.362342 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.363025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.365059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.388256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1197/2355] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:02:29 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:29.392089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.402780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34e973-4565-462e-a140-e6023b47c399 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.408329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.408994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.409282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.409564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.410317 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.412010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.423885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1159/2356] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:29.429711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.440162 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf7b86-1056-472f-8434-487729eecc94 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.446233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.447113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.447393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.447663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] PATH_INFO: `/v3/projects/ac943b4263604d178cb18d10697c4a79/users/7e5fa6fa6a4d4aed877f708a9996a5e4/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.464351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac943b4263604d178cb18d10697c4a79, user_id=7e5fa6fa6a4d4aed877f708a9996a5e4, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.467015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.486040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1198/2357] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:29 2022] PUT /identity/v3/projects/ac943b4263604d178cb18d10697c4a79/users/7e5fa6fa6a4d4aed877f708a9996a5e4/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:29.490344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.502107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4608-27f9-4573-8c46-1aefbe65e0ea admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.558810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f0b92-5b4b-407e-b9a8-9cbbbcc128da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.559474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f0b92-5b4b-407e-b9a8-9cbbbcc128da admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.559757 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f0b92-5b4b-407e-b9a8-9cbbbcc128da admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.560060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f0b92-5b4b-407e-b9a8-9cbbbcc128da admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.560780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f0b92-5b4b-407e-b9a8-9cbbbcc128da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.562378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f0b92-5b4b-407e-b9a8-9cbbbcc128da admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.572410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1160/2358] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:29.576800 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.587387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd75d3-0bbf-49c8-80b8-4d418f0a89e1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.592146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.593028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.593307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.593568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] PATH_INFO: `/v3/projects/ac943b4263604d178cb18d10697c4a79/users/7e5fa6fa6a4d4aed877f708a9996a5e4/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.595624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac943b4263604d178cb18d10697c4a79, user_id=7e5fa6fa6a4d4aed877f708a9996a5e4, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.598347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.609733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1199/2359] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:29 2022] PUT /identity/v3/projects/ac943b4263604d178cb18d10697c4a79/users/7e5fa6fa6a4d4aed877f708a9996a5e4/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:29.620309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5384-cc33-4b18-bc2c-185e166b91dc None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.620478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5384-cc33-4b18-bc2c-185e166b91dc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.620955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5384-cc33-4b18-bc2c-185e166b91dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.653969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a99b5384-cc33-4b18-bc2c-185e166b91dc None None] MFA Rules not processed for user `7e5fa6fa6a4d4aed877f708a9996a5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:29.655183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a99b5384-cc33-4b18-bc2c-185e166b91dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:29.726611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1161/2360] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:29.737863 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:29.739754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:29.804000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb5e3-5eaa-4e61-88d4-e8c77dce1486 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:29.808633 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f6c61-059f-4441-a59a-ceb77c693930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:29.809290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6c61-059f-4441-a59a-ceb77c693930 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:29.809590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6c61-059f-4441-a59a-ceb77c693930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:29.809883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6c61-059f-4441-a59a-ceb77c693930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:29.820220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f6c61-059f-4441-a59a-ceb77c693930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:29.821652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f6c61-059f-4441-a59a-ceb77c693930 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:29.831761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1200/2361] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:30.408337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5384-cc33-4b18-bc2c-185e166b91dc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:30.469027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5384-cc33-4b18-bc2c-185e166b91dc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:30.474369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:30.475728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:30.476134 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:30.476459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] PATH_INFO: `/v3/users/8b8e72d4176f45129892b3c78cdca498` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:30.477802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8e72d4176f45129892b3c78cdca498)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:30.481016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:30.529660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8e72d4176f45129892b3c78cdca498'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:30.536407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8e72d4176f45129892b3c78cdca498'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:30.537282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8e72d4176f45129892b3c78cdca498'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:30.549178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8e72d4176f45129892b3c78cdca498'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:30.549832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8e72d4176f45129892b3c78cdca498'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:30.563580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1162/2362] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:30 2022] DELETE /identity/v3/users/8b8e72d4176f45129892b3c78cdca498 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:30.568660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:30.569479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:30.569765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:30.587762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:30.589067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:30.650112 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1201/2363] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:30.659739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:30.661137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:30.720822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bc9a4-2811-48b8-be12-24e68e0bd11e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:30.724478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:30.725181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:30.725642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:30.725918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:30.735325 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:30.736798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:30.746271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1163/2364] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:02:31.038473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:31.039542 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:31.052673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573fdca-f004-4f63-b82e-b55caf4565a6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:31.063374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:31.065202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:31.065639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:31.066107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] PATH_INFO: `/v3/projects/522877ce2c4847298517db2d53831268` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:31.067587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522877ce2c4847298517db2d53831268)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:31.070171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:31.134735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522877ce2c4847298517db2d53831268', 'request_id': 'req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.143583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522877ce2c4847298517db2d53831268', 'request_id': 'req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.152903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522877ce2c4847298517db2d53831268', 'request_id': 'req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.171753 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] The token cache is being invalidate because project 522877ce2c4847298517db2d53831268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:31.172032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.172887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.174450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1202/2365] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:31 2022] DELETE /identity/v3/projects/522877ce2c4847298517db2d53831268 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:31.179082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:31.190450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393804c-95a0-4366-b560-0c2e1c9483aa service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:31.250860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:31.251650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:31.251969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:31.252250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] PATH_INFO: `/v3/users/7e5fa6fa6a4d4aed877f708a9996a5e4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:31.253433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5fa6fa6a4d4aed877f708a9996a5e4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:31.255378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:31.301083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5fa6fa6a4d4aed877f708a9996a5e4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.308014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5fa6fa6a4d4aed877f708a9996a5e4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.308817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5fa6fa6a4d4aed877f708a9996a5e4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.320372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5fa6fa6a4d4aed877f708a9996a5e4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.321347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cdd2dd63-2cad-42c5-8ff8-ffb3b396c0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5fa6fa6a4d4aed877f708a9996a5e4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.336072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1164/2366] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:31 2022] DELETE /identity/v3/users/7e5fa6fa6a4d4aed877f708a9996a5e4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:31.646803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:31.648274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:31.666981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2994-4b16-4160-b3d0-7f8c226ae9c3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:31.736728 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:31.737949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:31.738238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:31.738519 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] PATH_INFO: `/v3/projects/ac943b4263604d178cb18d10697c4a79` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:31.740015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac943b4263604d178cb18d10697c4a79)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:31.742179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:31.793998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac943b4263604d178cb18d10697c4a79', 'request_id': 'req-37024445-6465-4df9-926e-a1ca57a9d75f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.801524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac943b4263604d178cb18d10697c4a79', 'request_id': 'req-37024445-6465-4df9-926e-a1ca57a9d75f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.811669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac943b4263604d178cb18d10697c4a79', 'request_id': 'req-37024445-6465-4df9-926e-a1ca57a9d75f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.822734 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] The token cache is being invalidate because project ac943b4263604d178cb18d10697c4a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:31.823021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.823678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37024445-6465-4df9-926e-a1ca57a9d75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:31.825264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1203/2367] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:31 2022] DELETE /identity/v3/projects/ac943b4263604d178cb18d10697c4a79 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:31.830311 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c0c6-be4e-44ee-afb1-4361e1920def None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:31.830788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c0c6-be4e-44ee-afb1-4361e1920def None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:31.831028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659c0c6-be4e-44ee-afb1-4361e1920def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:31.850309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1659c0c6-be4e-44ee-afb1-4361e1920def None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:31.851780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1659c0c6-be4e-44ee-afb1-4361e1920def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:31.923120 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1165/2368] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:31.931198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dbef-7616-4bb5-8ef5-06bb9054e8e5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:31.931654 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dbef-7616-4bb5-8ef5-06bb9054e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:31.932007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dbef-7616-4bb5-8ef5-06bb9054e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:31.950934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c482dbef-7616-4bb5-8ef5-06bb9054e8e5 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:31.952070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c482dbef-7616-4bb5-8ef5-06bb9054e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:31.960178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1204/2369] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:31.964704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c0c6-be4e-44ee-afb1-4361e1920def None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:31.974203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659c0c6-be4e-44ee-afb1-4361e1920def None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:31.979381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:31.980085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:31.980366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:31.980637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:31.981362 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:02:31.981666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:31.983285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:31.995336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1166/2370] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:02:32.000629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482dbef-7616-4bb5-8ef5-06bb9054e8e5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.011665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482dbef-7616-4bb5-8ef5-06bb9054e8e5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.018318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.018992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.019276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.019551 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.020299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.022246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.050856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1205/2371] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:02:31 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:32.055176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.069991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bed6de-8609-4fc8-835d-2b946df309fd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.132989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.133898 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.134266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.134570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.135575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.138394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.161406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1167/2372] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:02:32 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:32.166853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.181487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84963-0d19-4349-ad15-ff8a6eed2e75 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.187177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.187847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.188164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.188440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.189173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.190790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.203036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1206/2373] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:32.207289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.217721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c647-0457-416d-a555-b9149f6915b1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.222730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44196a4-2ba9-4d74-b7c6-5bb148885e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.223416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44196a4-2ba9-4d74-b7c6-5bb148885e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.223680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44196a4-2ba9-4d74-b7c6-5bb148885e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.223994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44196a4-2ba9-4d74-b7c6-5bb148885e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.224707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44196a4-2ba9-4d74-b7c6-5bb148885e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.226519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44196a4-2ba9-4d74-b7c6-5bb148885e35 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.237423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1168/2374] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:32.241824 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.252649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b1f3-9fcc-464b-acbf-e3a4141ceb7e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.258355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.259260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.259526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.259832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] PATH_INFO: `/v3/projects/e982f875f9bf415ea143bff8c2a13295/users/1c4bb2cd174c4c5d83f27dbecba798af/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.276867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982f875f9bf415ea143bff8c2a13295, user_id=1c4bb2cd174c4c5d83f27dbecba798af, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.280132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.295126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1207/2375] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:32 2022] PUT /identity/v3/projects/e982f875f9bf415ea143bff8c2a13295/users/1c4bb2cd174c4c5d83f27dbecba798af/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:02:32.306294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202fea-8240-4950-bdd4-9ac2545df4cb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.306636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202fea-8240-4950-bdd4-9ac2545df4cb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.306920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202fea-8240-4950-bdd4-9ac2545df4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.335123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e9202fea-8240-4950-bdd4-9ac2545df4cb None None] MFA Rules not processed for user `1c4bb2cd174c4c5d83f27dbecba798af`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:32.336378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e9202fea-8240-4950-bdd4-9ac2545df4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:32.417925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1169/2376] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:32.423914 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.488933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ab173-b370-4f81-b1d1-155fd60c7a78 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.494285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.494947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.495233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.495508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.496245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.498164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.524388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1208/2377] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:02:32 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:32.528674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202fea-8240-4950-bdd4-9ac2545df4cb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.539359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202fea-8240-4950-bdd4-9ac2545df4cb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.599382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.599382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.599382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.599382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.600762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.601878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.627132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1170/2378] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:02:32 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:02:32.631118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.642000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509bd07-a3e3-4a39-9a9f-457561568096 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.647454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.648169 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.648748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.649236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.649980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.651597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.662667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1209/2379] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:32.666788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.676568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d677ba-db87-4d1c-ba5e-9a88d1b630a2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.681644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.682552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.682838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.683112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] PATH_INFO: `/v3/projects/ad741a1c46854f249f2792b2b270b5c6/users/645516c144ca4a3f82890e935eb270d2/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.697961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad741a1c46854f249f2792b2b270b5c6, user_id=645516c144ca4a3f82890e935eb270d2, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.700661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.716458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1171/2380] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:32 2022] PUT /identity/v3/projects/ad741a1c46854f249f2792b2b270b5c6/users/645516c144ca4a3f82890e935eb270d2/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:32.720522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.731623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ac1e6-1f8b-48b3-9e40-e6fa83fc766d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.791553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053581b-954a-4d81-9bd1-bd3c34efc5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.792366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053581b-954a-4d81-9bd1-bd3c34efc5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.792652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053581b-954a-4d81-9bd1-bd3c34efc5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.792929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053581b-954a-4d81-9bd1-bd3c34efc5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.793669 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053581b-954a-4d81-9bd1-bd3c34efc5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.795291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053581b-954a-4d81-9bd1-bd3c34efc5e2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.806577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1210/2381] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:02:32.810854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.821186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ffcbe-a5ac-4b2d-bf86-a7a7d341f065 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:32.825812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:32.826705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.826989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.827267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] PATH_INFO: `/v3/projects/ad741a1c46854f249f2792b2b270b5c6/users/645516c144ca4a3f82890e935eb270d2/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.829268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad741a1c46854f249f2792b2b270b5c6, user_id=645516c144ca4a3f82890e935eb270d2, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:32.831959 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:32.842697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1172/2382] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:02:32 2022] PUT /identity/v3/projects/ad741a1c46854f249f2792b2b270b5c6/users/645516c144ca4a3f82890e935eb270d2/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:32.854470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae4407-6ade-4910-a7ca-ebc6f68d6b79 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:32.854823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae4407-6ade-4910-a7ca-ebc6f68d6b79 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:32.855215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae4407-6ade-4910-a7ca-ebc6f68d6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:32.882713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5bae4407-6ade-4910-a7ca-ebc6f68d6b79 None None] MFA Rules not processed for user `645516c144ca4a3f82890e935eb270d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:32.883945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5bae4407-6ade-4910-a7ca-ebc6f68d6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:32.952335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1211/2383] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:02:32.963377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:32.965273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:33.024536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dbb6d-97f8-49c6-9844-a0f3b1f78dd0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:33.028263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:33.028903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:33.029209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:33.029491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:33.086527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:33.088185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:33.097807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1173/2384] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:02:34.809219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef04d-5656-46b2-8f5b-1288e170103b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:34.809742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef04d-5656-46b2-8f5b-1288e170103b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:34.809742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef04d-5656-46b2-8f5b-1288e170103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:34.827691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d84ef04d-5656-46b2-8f5b-1288e170103b None None] MFA Rules not processed for user `1ded6e90b10949dcb921119073f2d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:34.828947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d84ef04d-5656-46b2-8f5b-1288e170103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:34.887642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1212/2385] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:35.657368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:35.722172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5049c0-4d93-4d37-b92c-6fc2d2148058 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:35.726928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:35.728217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:35.728492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:35.728763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] PATH_INFO: `/v3/users/1c4bb2cd174c4c5d83f27dbecba798af` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:35.730101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4bb2cd174c4c5d83f27dbecba798af)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:35.732253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:35.784471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4bb2cd174c4c5d83f27dbecba798af'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:35.792015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4bb2cd174c4c5d83f27dbecba798af'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:35.792836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4bb2cd174c4c5d83f27dbecba798af'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:35.804839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4bb2cd174c4c5d83f27dbecba798af'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:35.805544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4bb2cd174c4c5d83f27dbecba798af'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:35.818526 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1174/2386] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:35 2022] DELETE /identity/v3/users/1c4bb2cd174c4c5d83f27dbecba798af => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:35.823220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:35.823858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:35.824180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:35.842341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:02:35.843597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:35.904099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1213/2387] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:02:35.915447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:35.916964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:35.978185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2f96-9143-4d39-bb49-1e1e4699a124 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:35.982083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:35.982773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:35.983031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:35.983310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:35.993268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:35.995123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:36.007693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1175/2388] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:02:36.280631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:36.282181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:36.300137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878105c-606b-46da-aee4-e458e2368cc4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:36.305129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:36.306040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:36.306276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:36.306552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] PATH_INFO: `/v3/projects/e982f875f9bf415ea143bff8c2a13295` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:36.307979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e982f875f9bf415ea143bff8c2a13295)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:36.309895 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:36.368739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e982f875f9bf415ea143bff8c2a13295', 'request_id': 'req-9b33bcb0-d478-4262-b9fa-3186957bf12b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.374826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e982f875f9bf415ea143bff8c2a13295', 'request_id': 'req-9b33bcb0-d478-4262-b9fa-3186957bf12b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.385204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e982f875f9bf415ea143bff8c2a13295', 'request_id': 'req-9b33bcb0-d478-4262-b9fa-3186957bf12b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.396789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] The token cache is being invalidate because project e982f875f9bf415ea143bff8c2a13295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:36.397146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.397798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.399392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1214/2389] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:36 2022] DELETE /identity/v3/projects/e982f875f9bf415ea143bff8c2a13295 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:36.403689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:36.413784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff41002-37b8-44cc-876a-ed32dc1e549d service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:36.482011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:36.482901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:36.483185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:36.483458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] PATH_INFO: `/v3/users/645516c144ca4a3f82890e935eb270d2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:36.484716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=645516c144ca4a3f82890e935eb270d2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:36.486749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:36.539640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645516c144ca4a3f82890e935eb270d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.546569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645516c144ca4a3f82890e935eb270d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.547298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645516c144ca4a3f82890e935eb270d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.559407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645516c144ca4a3f82890e935eb270d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.560112 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5fc69b29-2552-4671-99d2-80e1e0933eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645516c144ca4a3f82890e935eb270d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:36.575313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1176/2390] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:02:36 2022] DELETE /identity/v3/users/645516c144ca4a3f82890e935eb270d2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:02:36.981639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:02:36.983992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:02:37.005430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33bcb0-d478-4262-b9fa-3186957bf12b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:02:37.075983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:02:37.077189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:02:37.077471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:02:37.078155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] PATH_INFO: `/v3/projects/ad741a1c46854f249f2792b2b270b5c6` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:02:37.079037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad741a1c46854f249f2792b2b270b5c6)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:02:37.080999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:02:37.126711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad741a1c46854f249f2792b2b270b5c6', 'request_id': 'req-6d0b4f3b-a612-416c-9e72-149531a12cd3'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:37.133301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad741a1c46854f249f2792b2b270b5c6', 'request_id': 'req-6d0b4f3b-a612-416c-9e72-149531a12cd3'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:37.141750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad741a1c46854f249f2792b2b270b5c6', 'request_id': 'req-6d0b4f3b-a612-416c-9e72-149531a12cd3'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:37.152086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] The token cache is being invalidate because project ad741a1c46854f249f2792b2b270b5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:02:37.152378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:37.153036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:02:37.154688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1215/2391] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:02:36 2022] DELETE /identity/v3/projects/ad741a1c46854f249f2792b2b270b5c6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:03:11.807113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:11.807654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:11.807654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:11.825699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:11.826909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:11.886874 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1177/2392] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 15:03:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:11.943601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:11.945371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:12.027166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4f3b-a612-416c-9e72-149531a12cd3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:12.033131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:12.033765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:12.034083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:12.034391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:12.043003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:12.044639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:12.054529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1216/2393] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:03:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:03:25.747080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:25.748820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:25.814373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2e3ef-a2aa-4281-86e8-d6a8b3596e23 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:25.818396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:25.819059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:25.819338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:25.819607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:25.821434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:25.904165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:25.904165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:25.906491 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1178/2394] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:25.973785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:25.975085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:26.030817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd626ce-ba6a-4456-ad5a-cf690e19e692 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:26.034734 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0d37c-fe49-4cb2-b602-9d9d3c797a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:26.035374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0d37c-fe49-4cb2-b602-9d9d3c797a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:26.035774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0d37c-fe49-4cb2-b602-9d9d3c797a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:26.036140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0d37c-fe49-4cb2-b602-9d9d3c797a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:26.038236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ebf0d37c-fe49-4cb2-b602-9d9d3c797a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:26.047703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0d37c-fe49-4cb2-b602-9d9d3c797a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:26.049165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0d37c-fe49-4cb2-b602-9d9d3c797a67 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:26.056916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1217/2395] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:03:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:26.144987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:26.147144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:26.160613 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289402ed-bdaf-4b60-b1ef-790210d6925b service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:26.164998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:26.165651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:26.165931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:26.166205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:26.168189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:26.181957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:26.183421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:26.194813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1179/2396] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:28.133968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914826e5-250e-49e0-8a85-e6db663390bf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:28.134470 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914826e5-250e-49e0-8a85-e6db663390bf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:28.134570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914826e5-250e-49e0-8a85-e6db663390bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:28.155201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-914826e5-250e-49e0-8a85-e6db663390bf None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:28.156457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-914826e5-250e-49e0-8a85-e6db663390bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:28.164445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1218/2397] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:28.177049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:28.188626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a87a-6de1-43a0-abfc-336bc401c275 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:28.194994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:28.195622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:28.196125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:28.196407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:28.205245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:28.206847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:28.215645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1180/2398] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:03:48.917577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdf83a-d265-4d7a-a9a4-0ea89945c4e7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:48.918219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdf83a-d265-4d7a-a9a4-0ea89945c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:48.918219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdf83a-d265-4d7a-a9a4-0ea89945c4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:48.936879 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f8bdf83a-d265-4d7a-a9a4-0ea89945c4e7 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:48.938059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8bdf83a-d265-4d7a-a9a4-0ea89945c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:48.946041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1219/2399] 10.222.0.99 () {58 vars in 967 bytes} [Fri May 13 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:48.958368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:48.969590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62418-c224-40bf-9de9-b330848e307a service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:48.975652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:48.976670 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:48.976955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:48.977227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:48.985551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:48.987144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:48.995464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1181/2400] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:03:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:04:03.792451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdf83a-d265-4d7a-a9a4-0ea89945c4e7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:03.802012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdf83a-d265-4d7a-a9a4-0ea89945c4e7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:03.805740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:03.806384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:03.806668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:03.806915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:03.808777 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:03.878009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:03.879473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:03.890335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1220/2401] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:07.316292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:07.318537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:07.339275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802489-b4d4-4830-a705-6550d7a3535d service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:07.344347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:07.345229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:07.345539 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:07.345816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] PATH_INFO: `/v3/users/fbe6cc242fbf40cf8250dabaa336f648` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:07.363498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe6cc242fbf40cf8250dabaa336f648)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:07.366626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:07.428585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe6cc242fbf40cf8250dabaa336f648'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.435608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe6cc242fbf40cf8250dabaa336f648'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.436216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe6cc242fbf40cf8250dabaa336f648'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.448298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe6cc242fbf40cf8250dabaa336f648'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.449015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-926f3fa9-8d08-42a1-8f73-07e98d88f290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe6cc242fbf40cf8250dabaa336f648'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.468485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1182/2402] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:07 2022] DELETE /identity/v3/users/fbe6cc242fbf40cf8250dabaa336f648 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:07.645977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:07.655741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8054995-4221-4b18-abd1-ba309eaca54f service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:07.717555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:07.718429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:07.718710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:07.718988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] PATH_INFO: `/v3/projects/634e7491dc6e43f98fb82baba250b09b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:07.730297 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] RBAC: Authorizing `identity:delete_project(project_id=634e7491dc6e43f98fb82baba250b09b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:07.732240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:07.779823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634e7491dc6e43f98fb82baba250b09b', 'request_id': 'req-f0a9774f-30e6-4323-be7a-275c38b3184e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.786562 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634e7491dc6e43f98fb82baba250b09b', 'request_id': 'req-f0a9774f-30e6-4323-be7a-275c38b3184e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.795399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634e7491dc6e43f98fb82baba250b09b', 'request_id': 'req-f0a9774f-30e6-4323-be7a-275c38b3184e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.805514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] The token cache is being invalidate because project 634e7491dc6e43f98fb82baba250b09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:07.805797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.806460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f0a9774f-30e6-4323-be7a-275c38b3184e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:07.808106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1221/2403] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:07 2022] DELETE /identity/v3/projects/634e7491dc6e43f98fb82baba250b09b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:07.813237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c8af-2be9-4749-8f45-7b34d3848f69 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:07.813529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c8af-2be9-4749-8f45-7b34d3848f69 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:07.813808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c8af-2be9-4749-8f45-7b34d3848f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:07.834211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6cd8c8af-2be9-4749-8f45-7b34d3848f69 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:07.835366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6cd8c8af-2be9-4749-8f45-7b34d3848f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:07.895545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1183/2404] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:07.903698 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97eab9-5394-463a-861c-c6122d7ccc54 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:07.904031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97eab9-5394-463a-861c-c6122d7ccc54 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:07.904305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97eab9-5394-463a-861c-c6122d7ccc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:07.923784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0a97eab9-5394-463a-861c-c6122d7ccc54 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:07.925309 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0a97eab9-5394-463a-861c-c6122d7ccc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:07.934492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1222/2405] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:07.938847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c8af-2be9-4749-8f45-7b34d3848f69 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:07.948630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c8af-2be9-4749-8f45-7b34d3848f69 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:07.953404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:07.954064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:07.954343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:07.954622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:07.955647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:07.955989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:07.957606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:07.969401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1184/2406] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:07.974017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97eab9-5394-463a-861c-c6122d7ccc54 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:07.984369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97eab9-5394-463a-861c-c6122d7ccc54 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:07.989514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:07.990157 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:07.990439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:07.990755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:07.991417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:07.993352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.021195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1223/2407] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:07 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:08.025237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.037538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9322f-5681-4005-9295-37ab2707c258 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.117358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.117946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.118229 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.118484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.119188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.121171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.144352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1185/2408] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:08 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:08.150359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.166411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aa7cf-48f4-42c1-8071-aea08449dff9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.174043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.174707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.174988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.175260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.176028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.177617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.187605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1224/2409] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:08.192933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.208290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd489caa-e225-4646-bf16-cc58649a8af3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.214020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a37aa-34a1-4ebd-8e02-f74123e0e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.214689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a37aa-34a1-4ebd-8e02-f74123e0e777 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.214970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a37aa-34a1-4ebd-8e02-f74123e0e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.215240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a37aa-34a1-4ebd-8e02-f74123e0e777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.216365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a37aa-34a1-4ebd-8e02-f74123e0e777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.217609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a37aa-34a1-4ebd-8e02-f74123e0e777 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.229609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1186/2410] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:08.234227 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.244428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8939daa-e7dc-45b7-93f8-c9c4ab0e1bd1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.249205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.250096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.250375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.250649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] PATH_INFO: `/v3/projects/f12641d481b34af4aac8fd2324e33d1a/users/560ffaf4c69f454fa174c040bef4c91b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.266779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12641d481b34af4aac8fd2324e33d1a, user_id=560ffaf4c69f454fa174c040bef4c91b, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.271382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.287429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1225/2411] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:08 2022] PUT /identity/v3/projects/f12641d481b34af4aac8fd2324e33d1a/users/560ffaf4c69f454fa174c040bef4c91b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:08.298397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14550-4626-4406-91ed-ee8a4edcd026 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.298690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14550-4626-4406-91ed-ee8a4edcd026 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.299016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14550-4626-4406-91ed-ee8a4edcd026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.325580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2ac14550-4626-4406-91ed-ee8a4edcd026 None None] MFA Rules not processed for user `560ffaf4c69f454fa174c040bef4c91b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:08.327205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2ac14550-4626-4406-91ed-ee8a4edcd026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:08.394793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1187/2412] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:08.399438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.460255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b646e76-3b28-4eea-b051-3b2b92076866 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.465617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.466287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.466570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.466843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.467540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.469511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.498811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1226/2413] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:08 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:08.502778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac14550-4626-4406-91ed-ee8a4edcd026 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.514133 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac14550-4626-4406-91ed-ee8a4edcd026 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.576369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.577051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.577330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.577637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.578911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.580520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.605123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1188/2414] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:08 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:08.609533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.624855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d351fbf-d71e-4fed-94b4-f075ec4d7fd7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.630512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.631197 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.635921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.635921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.635921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.635921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.649091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1227/2415] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:04:08.653350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.664195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f0c51-e3e8-4d34-8210-3a4870b17934 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.668891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.670259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.670538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.670874 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] PATH_INFO: `/v3/projects/ce02d173d02d47bf86fee622012c9bbf/users/05d698b5dcf3404c9e187e3684d70fa1/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.686888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce02d173d02d47bf86fee622012c9bbf, user_id=05d698b5dcf3404c9e187e3684d70fa1, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.689606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.705166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1189/2416] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:08 2022] PUT /identity/v3/projects/ce02d173d02d47bf86fee622012c9bbf/users/05d698b5dcf3404c9e187e3684d70fa1/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:08.708898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.719434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41ab77-ec84-427c-aa56-f7d5001303eb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.776881 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f617-3543-4a16-9db5-3f8d21b8983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.777556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f617-3543-4a16-9db5-3f8d21b8983b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.777836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f617-3543-4a16-9db5-3f8d21b8983b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.778111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f617-3543-4a16-9db5-3f8d21b8983b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.778838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f617-3543-4a16-9db5-3f8d21b8983b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.780492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f617-3543-4a16-9db5-3f8d21b8983b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.790702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1228/2417] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:08.799253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.806001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08883b9d-9ef8-40b5-b704-6ed3ae9c73cb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:08.811122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:08.812052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.812307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.812604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] PATH_INFO: `/v3/projects/ce02d173d02d47bf86fee622012c9bbf/users/05d698b5dcf3404c9e187e3684d70fa1/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.814846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce02d173d02d47bf86fee622012c9bbf, user_id=05d698b5dcf3404c9e187e3684d70fa1, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:08.817672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:08.828369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1190/2418] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:08 2022] PUT /identity/v3/projects/ce02d173d02d47bf86fee622012c9bbf/users/05d698b5dcf3404c9e187e3684d70fa1/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:08.838903 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ffaa-6180-4736-95b0-a7f497cc47fc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:08.839194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ffaa-6180-4736-95b0-a7f497cc47fc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:08.839468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ffaa-6180-4736-95b0-a7f497cc47fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:08.866637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7dd1ffaa-6180-4736-95b0-a7f497cc47fc None None] MFA Rules not processed for user `05d698b5dcf3404c9e187e3684d70fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:08.867845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7dd1ffaa-6180-4736-95b0-a7f497cc47fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:08.938523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1229/2419] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:08.951372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:08.953432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:09.020532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f111-a5b2-405d-8e4c-b1406f84c59b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:09.027370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dccfc-f61e-47f5-81c8-289ff020942d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:09.028269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dccfc-f61e-47f5-81c8-289ff020942d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:09.028545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dccfc-f61e-47f5-81c8-289ff020942d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:09.028812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dccfc-f61e-47f5-81c8-289ff020942d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:09.040824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dccfc-f61e-47f5-81c8-289ff020942d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:09.042279 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dccfc-f61e-47f5-81c8-289ff020942d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:09.051824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1191/2420] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:09.491223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ffaa-6180-4736-95b0-a7f497cc47fc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:09.553408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ffaa-6180-4736-95b0-a7f497cc47fc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:09.558371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:09.559243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:09.559522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:09.559798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] PATH_INFO: `/v3/users/560ffaf4c69f454fa174c040bef4c91b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:09.561052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] RBAC: Authorizing `identity:delete_user(user_id=560ffaf4c69f454fa174c040bef4c91b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:09.562981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:09.618738 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560ffaf4c69f454fa174c040bef4c91b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:09.628638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560ffaf4c69f454fa174c040bef4c91b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:09.640752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560ffaf4c69f454fa174c040bef4c91b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:09.647386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560ffaf4c69f454fa174c040bef4c91b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:09.648083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560ffaf4c69f454fa174c040bef4c91b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:09.654183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1230/2421] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:09 2022] DELETE /identity/v3/users/560ffaf4c69f454fa174c040bef4c91b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:09.659888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:09.660525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:09.660525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:09.679694 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:09.680951 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:09.747209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1192/2422] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:09.757822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:09.759664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:09.794217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:09.795739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:09.821037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626aaf-678a-4366-8cdd-440b04be890b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:09.824929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:09.825579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:09.825857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:09.826136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:09.836008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:09.837567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:09.849448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1231/2423] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:09.857913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcd778-c12d-4006-b36d-f7b9ff8cdf27 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:09.861542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:09.862205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:09.862488 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:09.862765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:09.865064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:09.939375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:09.941107 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:09.952828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1193/2424] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:04:10.125999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:10.127574 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:10.146118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716172c-a1b1-42e1-99a0-db35c090fb8a service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:10.153298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:10.155557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:10.156586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:10.157317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] PATH_INFO: `/v3/projects/f12641d481b34af4aac8fd2324e33d1a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:10.159307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12641d481b34af4aac8fd2324e33d1a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:10.161362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:10.211404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12641d481b34af4aac8fd2324e33d1a', 'request_id': 'req-1fab0756-d83c-44b3-a3c2-8e8b7e176027'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.218590 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12641d481b34af4aac8fd2324e33d1a', 'request_id': 'req-1fab0756-d83c-44b3-a3c2-8e8b7e176027'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.227466 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12641d481b34af4aac8fd2324e33d1a', 'request_id': 'req-1fab0756-d83c-44b3-a3c2-8e8b7e176027'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.238253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] The token cache is being invalidate because project f12641d481b34af4aac8fd2324e33d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:10.238600 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.239553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.241253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1232/2425] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:10 2022] DELETE /identity/v3/projects/f12641d481b34af4aac8fd2324e33d1a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:10.245406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:10.261913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12796e07-68f4-451c-b2ad-da965ccee09c service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:10.317786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:10.318674 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:10.318953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:10.319225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] PATH_INFO: `/v3/users/05d698b5dcf3404c9e187e3684d70fa1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:10.320451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d698b5dcf3404c9e187e3684d70fa1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:10.322395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:10.369812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d698b5dcf3404c9e187e3684d70fa1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.376650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d698b5dcf3404c9e187e3684d70fa1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.377334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d698b5dcf3404c9e187e3684d70fa1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.390016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d698b5dcf3404c9e187e3684d70fa1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.390724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab12a8d6-27de-4ccf-bb16-2d31c83c3cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d698b5dcf3404c9e187e3684d70fa1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.406893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1194/2426] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:10 2022] DELETE /identity/v3/users/05d698b5dcf3404c9e187e3684d70fa1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:10.686652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:10.688248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:10.701355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0756-d83c-44b3-a3c2-8e8b7e176027 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:10.770196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:10.771196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:10.771479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:10.771853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] PATH_INFO: `/v3/projects/ce02d173d02d47bf86fee622012c9bbf` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:10.773192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce02d173d02d47bf86fee622012c9bbf)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:10.775469 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:10.832287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce02d173d02d47bf86fee622012c9bbf', 'request_id': 'req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.838984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce02d173d02d47bf86fee622012c9bbf', 'request_id': 'req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.846386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce02d173d02d47bf86fee622012c9bbf', 'request_id': 'req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.857400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] The token cache is being invalidate because project ce02d173d02d47bf86fee622012c9bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:10.857683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.858397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ae867b5a-d4a1-4b2a-8340-b1c7ef3164b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:10.860100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1233/2427] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:10 2022] DELETE /identity/v3/projects/ce02d173d02d47bf86fee622012c9bbf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:10.865257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce71ee9-a9d8-4f9a-afa1-cae5d290e6ee None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:10.865745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce71ee9-a9d8-4f9a-afa1-cae5d290e6ee None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:10.865855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce71ee9-a9d8-4f9a-afa1-cae5d290e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:10.883548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4ce71ee9-a9d8-4f9a-afa1-cae5d290e6ee None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:10.884769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4ce71ee9-a9d8-4f9a-afa1-cae5d290e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:10.948141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1195/2428] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:10.958049 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb0209-bce0-463d-a727-fefe5a7979e6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:10.958370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb0209-bce0-463d-a727-fefe5a7979e6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:10.958656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb0209-bce0-463d-a727-fefe5a7979e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:10.980074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-91fb0209-bce0-463d-a727-fefe5a7979e6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:10.981212 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-91fb0209-bce0-463d-a727-fefe5a7979e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:10.991433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1234/2429] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:10.996241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce71ee9-a9d8-4f9a-afa1-cae5d290e6ee None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.009643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce71ee9-a9d8-4f9a-afa1-cae5d290e6ee None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.014457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.015120 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.015400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.015678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.016471 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:11.016780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.018415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.031062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1196/2430] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:11.035833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb0209-bce0-463d-a727-fefe5a7979e6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.045783 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb0209-bce0-463d-a727-fefe5a7979e6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.051703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.052396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.052677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.052947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.053632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.055577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.083292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1235/2431] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:11 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:11.087703 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.099899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f234b9-e036-4ec6-b658-c772204f3eb5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.163656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.164360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.164645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.164920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.165610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.167551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.190456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1197/2432] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:11 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:11.194750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.205137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82655dc-a019-4543-a51e-37b71468948d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.212678 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.213720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.214106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.214480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.215548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.218108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.231278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1236/2433] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:04:11.235529 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.247026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d54a-77fb-4aa9-b51e-4c55845628e4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.253269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4808dc2-d8bc-4f23-996d-683a3989a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.253942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808dc2-d8bc-4f23-996d-683a3989a6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.254285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808dc2-d8bc-4f23-996d-683a3989a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.254658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808dc2-d8bc-4f23-996d-683a3989a6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.255394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808dc2-d8bc-4f23-996d-683a3989a6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.257062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808dc2-d8bc-4f23-996d-683a3989a6e2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.267245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1198/2434] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:04:11.271817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.281882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2235-4662-462a-8803-b0c9354a5582 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.286973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.287856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.288174 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.288452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] PATH_INFO: `/v3/projects/165a2ca6346c49c6aa5324226ab44b4e/users/708e7e120b5d4680a6a308232525cfcf/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.304411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165a2ca6346c49c6aa5324226ab44b4e, user_id=708e7e120b5d4680a6a308232525cfcf, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.307133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.322028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1237/2435] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:11 2022] PUT /identity/v3/projects/165a2ca6346c49c6aa5324226ab44b4e/users/708e7e120b5d4680a6a308232525cfcf/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:11.334322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534c51-e745-41e0-a0d9-2cae7b22788a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.334805 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534c51-e745-41e0-a0d9-2cae7b22788a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.335326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534c51-e745-41e0-a0d9-2cae7b22788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.371290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a2534c51-e745-41e0-a0d9-2cae7b22788a None None] MFA Rules not processed for user `708e7e120b5d4680a6a308232525cfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:11.373147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2534c51-e745-41e0-a0d9-2cae7b22788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:11.455389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1199/2436] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:04:11.460884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.529014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb03c7-c615-471e-9b94-5c8f79214e99 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.533857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.534550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.534827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.535099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.536033 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.537952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.566226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1238/2437] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:11 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:11.571994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534c51-e745-41e0-a0d9-2cae7b22788a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.583090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534c51-e745-41e0-a0d9-2cae7b22788a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.638944 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.639636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.639896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.640211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.640890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.642819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.664658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1200/2438] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:11 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:04:11.668790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.679430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0b24b-b481-41d6-8769-2ec3fa514b40 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.684504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.685151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.685431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.685701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.686418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.688532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.699313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1239/2439] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:11.703629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.713764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103d46-f23c-436a-8b71-358945d919c5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.718763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.719666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.719975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.720255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] PATH_INFO: `/v3/projects/2da8e52f3d6c4ebabb2f3d4f9f20ab14/users/d817de95980840bf90b746a7533009c2/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.735740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da8e52f3d6c4ebabb2f3d4f9f20ab14, user_id=d817de95980840bf90b746a7533009c2, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.738531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.752786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1201/2440] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:11 2022] PUT /identity/v3/projects/2da8e52f3d6c4ebabb2f3d4f9f20ab14/users/d817de95980840bf90b746a7533009c2/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:11.756944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.767612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59eaa-d0c1-458c-859a-019c0ebdd38d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.838679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cac17-4f6e-4ce2-b033-f4e451ad4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.839558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cac17-4f6e-4ce2-b033-f4e451ad4140 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.839888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cac17-4f6e-4ce2-b033-f4e451ad4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.840192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cac17-4f6e-4ce2-b033-f4e451ad4140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.841068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cac17-4f6e-4ce2-b033-f4e451ad4140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.842928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cac17-4f6e-4ce2-b033-f4e451ad4140 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.854129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1240/2441] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:11.858359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:11.872111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961d580-0dcd-4dc4-981a-ee95a525cc93 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:11.878162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:11.879082 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.879357 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.879606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] PATH_INFO: `/v3/projects/2da8e52f3d6c4ebabb2f3d4f9f20ab14/users/d817de95980840bf90b746a7533009c2/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.881842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da8e52f3d6c4ebabb2f3d4f9f20ab14, user_id=d817de95980840bf90b746a7533009c2, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:11.884552 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:11.895318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1202/2442] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:11 2022] PUT /identity/v3/projects/2da8e52f3d6c4ebabb2f3d4f9f20ab14/users/d817de95980840bf90b746a7533009c2/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:11.905653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d7601-bc84-474e-a33b-f5703fed6c8a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:11.905946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d7601-bc84-474e-a33b-f5703fed6c8a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:11.906208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d7601-bc84-474e-a33b-f5703fed6c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:11.943312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-652d7601-bc84-474e-a33b-f5703fed6c8a None None] MFA Rules not processed for user `d817de95980840bf90b746a7533009c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:11.944534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-652d7601-bc84-474e-a33b-f5703fed6c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:12.021838 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1241/2443] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:12.037792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:12.040728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:12.110698 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd52fa-5c1e-4d6b-a12d-a58e779279f2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:12.115404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46593b-fd82-41d1-a4c3-572a55d3119e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:12.116103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46593b-fd82-41d1-a4c3-572a55d3119e service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:12.116350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46593b-fd82-41d1-a4c3-572a55d3119e service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:12.116830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46593b-fd82-41d1-a4c3-572a55d3119e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:12.127996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46593b-fd82-41d1-a4c3-572a55d3119e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:12.129693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46593b-fd82-41d1-a4c3-572a55d3119e service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:12.139227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1203/2444] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:12.205465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d7601-bc84-474e-a33b-f5703fed6c8a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:12.274613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d7601-bc84-474e-a33b-f5703fed6c8a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:12.280102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:12.281001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:12.281287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:12.281560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] PATH_INFO: `/v3/users/708e7e120b5d4680a6a308232525cfcf` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:12.282842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=708e7e120b5d4680a6a308232525cfcf)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:12.284811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:12.344078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708e7e120b5d4680a6a308232525cfcf'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.353860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708e7e120b5d4680a6a308232525cfcf'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.369475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708e7e120b5d4680a6a308232525cfcf'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.380328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708e7e120b5d4680a6a308232525cfcf'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.381083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708e7e120b5d4680a6a308232525cfcf'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.387296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1242/2445] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:12 2022] DELETE /identity/v3/users/708e7e120b5d4680a6a308232525cfcf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:12.392989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:12.393501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:12.393942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:12.421514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:12.423373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:12.494848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1204/2446] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:12.506696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:12.508331 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:12.567282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80aae-9e84-4a78-a4d1-761cd7244a1f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:12.571538 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:12.572255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:12.572537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:12.572813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:12.582905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:12.584420 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:12.594061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1243/2447] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:12.873685 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:12.875218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:12.887834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c931-e7db-48ce-b632-d01c73c62299 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:12.894220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:12.895180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:12.895436 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:12.895712 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] PATH_INFO: `/v3/projects/165a2ca6346c49c6aa5324226ab44b4e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:12.897486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165a2ca6346c49c6aa5324226ab44b4e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:12.899950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:12.950637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165a2ca6346c49c6aa5324226ab44b4e', 'request_id': 'req-203c4445-da97-4cee-bcce-82d0cc99b3d6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.957244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165a2ca6346c49c6aa5324226ab44b4e', 'request_id': 'req-203c4445-da97-4cee-bcce-82d0cc99b3d6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.965860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165a2ca6346c49c6aa5324226ab44b4e', 'request_id': 'req-203c4445-da97-4cee-bcce-82d0cc99b3d6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.980775 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] The token cache is being invalidate because project 165a2ca6346c49c6aa5324226ab44b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:12.981092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.981897 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:12.983571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1205/2448] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:12 2022] DELETE /identity/v3/projects/165a2ca6346c49c6aa5324226ab44b4e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:12.989443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:13.000565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1cd70-073a-4691-9265-3c3bcf6491c3 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:13.058620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:13.059504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.059788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.060093 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] PATH_INFO: `/v3/users/d817de95980840bf90b746a7533009c2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.061320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d817de95980840bf90b746a7533009c2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:13.063259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:13.120110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd817de95980840bf90b746a7533009c2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.128742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd817de95980840bf90b746a7533009c2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.142496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd817de95980840bf90b746a7533009c2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.149549 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd817de95980840bf90b746a7533009c2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.150233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-925852d3-48a9-453e-a9b1-c34c63496aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd817de95980840bf90b746a7533009c2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.156277 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1244/2449] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:12 2022] DELETE /identity/v3/users/d817de95980840bf90b746a7533009c2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:13.433228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:13.434758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:13.449376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c4445-da97-4cee-bcce-82d0cc99b3d6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:13.515631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:13.516564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.516849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.517124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] PATH_INFO: `/v3/projects/2da8e52f3d6c4ebabb2f3d4f9f20ab14` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.518428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da8e52f3d6c4ebabb2f3d4f9f20ab14)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:13.521060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:13.570487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da8e52f3d6c4ebabb2f3d4f9f20ab14', 'request_id': 'req-5dd7d588-2433-433e-94c4-dec677d0722c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.576652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da8e52f3d6c4ebabb2f3d4f9f20ab14', 'request_id': 'req-5dd7d588-2433-433e-94c4-dec677d0722c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.587309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da8e52f3d6c4ebabb2f3d4f9f20ab14', 'request_id': 'req-5dd7d588-2433-433e-94c4-dec677d0722c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.599354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] The token cache is being invalidate because project 2da8e52f3d6c4ebabb2f3d4f9f20ab14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:13.599640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.600652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5dd7d588-2433-433e-94c4-dec677d0722c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:13.602221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1206/2450] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:13 2022] DELETE /identity/v3/projects/2da8e52f3d6c4ebabb2f3d4f9f20ab14 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:13.609781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25ecf-29db-4845-b5e2-d9f6244e27c1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.610166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25ecf-29db-4845-b5e2-d9f6244e27c1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.610555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25ecf-29db-4845-b5e2-d9f6244e27c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.636866 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-52f25ecf-29db-4845-b5e2-d9f6244e27c1 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:13.638058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-52f25ecf-29db-4845-b5e2-d9f6244e27c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:13.703858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1245/2451] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:13.714329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ebea-b175-4253-baf0-5f00517bf4b7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.714665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ebea-b175-4253-baf0-5f00517bf4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.715039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ebea-b175-4253-baf0-5f00517bf4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.737632 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a832ebea-b175-4253-baf0-5f00517bf4b7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:13.739277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a832ebea-b175-4253-baf0-5f00517bf4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:13.748971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1207/2452] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:13.753643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25ecf-29db-4845-b5e2-d9f6244e27c1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:13.764335 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25ecf-29db-4845-b5e2-d9f6244e27c1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:13.770426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:13.770930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.771291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.771643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.772489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:13.772795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:13.774431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:13.786765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1246/2453] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:13.792743 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ebea-b175-4253-baf0-5f00517bf4b7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:13.802313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ebea-b175-4253-baf0-5f00517bf4b7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:13.808090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:13.808780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.809058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.809330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.810024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:13.811991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:13.844041 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1208/2454] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:13 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:13.848541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:13.858972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16d17c-3804-4c41-9e14-c8774949b31c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:13.915803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:13.916447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.916722 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.917030 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.917676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:13.919596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:13.947154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1247/2455] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:13 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:13.951451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:13.963194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf911af6-56e6-4af2-9775-3f3c243b1829 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:13.969010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:13.969681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:13.969963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:13.970240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:13.971070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:13.972748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:13.984027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1209/2456] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:13.988345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:13.999326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46dda-1f18-4b98-947b-164766314b98 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.004909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6499d2-3c69-4277-971e-2e0b3b9dcdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.005902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6499d2-3c69-4277-971e-2e0b3b9dcdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.006310 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6499d2-3c69-4277-971e-2e0b3b9dcdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.006580 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6499d2-3c69-4277-971e-2e0b3b9dcdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.007402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6499d2-3c69-4277-971e-2e0b3b9dcdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.009349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6499d2-3c69-4277-971e-2e0b3b9dcdc2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.020860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1248/2457] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:14.025206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.037604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081227a-6186-47fd-a0dc-2832a90ecb46 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.043941 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.045007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.045367 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.045634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] PATH_INFO: `/v3/projects/7a412009dd224ce48c11f001593afbba/users/9cd7708d99c84f6ab81246f47bc17fec/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.061793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a412009dd224ce48c11f001593afbba, user_id=9cd7708d99c84f6ab81246f47bc17fec, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.064536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.080877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1210/2458] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:14 2022] PUT /identity/v3/projects/7a412009dd224ce48c11f001593afbba/users/9cd7708d99c84f6ab81246f47bc17fec/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:14.091508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66db0-5f77-43a9-8b27-3ab26c7161e2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.091805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66db0-5f77-43a9-8b27-3ab26c7161e2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.092121 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66db0-5f77-43a9-8b27-3ab26c7161e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.121146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f8f66db0-5f77-43a9-8b27-3ab26c7161e2 None None] MFA Rules not processed for user `9cd7708d99c84f6ab81246f47bc17fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:14.122369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8f66db0-5f77-43a9-8b27-3ab26c7161e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:14.204552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1249/2459] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:14.212477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.280355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79733c-aa0a-4e19-bdd7-51dcf46aec46 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.286385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.287048 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.287337 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.287615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.288330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.290297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.318710 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1211/2460] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:14 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:14.322910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66db0-5f77-43a9-8b27-3ab26c7161e2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.334012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66db0-5f77-43a9-8b27-3ab26c7161e2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.393693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.394366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.394653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.394928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.396180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.398120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.420534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1250/2461] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:14 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:14.424718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.435418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d2e0d-2c9d-4841-ad1d-2176e6a649a0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.440602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.441525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.441859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.442745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.443423 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.445084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.455987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1212/2462] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:14.460257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.470504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea28e4-ecca-40be-ae70-b8de629e7fd1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.478173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.479085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.479365 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.479641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] PATH_INFO: `/v3/projects/ef9b020773284eb09beb585aa5646161/users/5875dc0c5afc4327988af7c10bf44da6/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.495448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9b020773284eb09beb585aa5646161, user_id=5875dc0c5afc4327988af7c10bf44da6, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.498161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.515029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1251/2463] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:14 2022] PUT /identity/v3/projects/ef9b020773284eb09beb585aa5646161/users/5875dc0c5afc4327988af7c10bf44da6/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:14.519189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.529918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd353748-41e4-47a0-9879-2f6c94e4bd6e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.589297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d3084-0eeb-49fd-a0c9-f96866d0f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.590010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d3084-0eeb-49fd-a0c9-f96866d0f7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.590296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d3084-0eeb-49fd-a0c9-f96866d0f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.590568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d3084-0eeb-49fd-a0c9-f96866d0f7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.591303 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d3084-0eeb-49fd-a0c9-f96866d0f7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.593016 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d3084-0eeb-49fd-a0c9-f96866d0f7a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.603888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1213/2464] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:14.608427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.619431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452680c-b199-4275-92fe-f83607a0de0b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.625425 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.626318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.626606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.626877 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] PATH_INFO: `/v3/projects/ef9b020773284eb09beb585aa5646161/users/5875dc0c5afc4327988af7c10bf44da6/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.629111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9b020773284eb09beb585aa5646161, user_id=5875dc0c5afc4327988af7c10bf44da6, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.632077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.643359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1252/2465] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:14 2022] PUT /identity/v3/projects/ef9b020773284eb09beb585aa5646161/users/5875dc0c5afc4327988af7c10bf44da6/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:14.654249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9906b9-0c8b-413e-9442-7912053a5bf1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.654541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9906b9-0c8b-413e-9442-7912053a5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.654820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9906b9-0c8b-413e-9442-7912053a5bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.686344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4b9906b9-0c8b-413e-9442-7912053a5bf1 None None] MFA Rules not processed for user `5875dc0c5afc4327988af7c10bf44da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:14.687538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4b9906b9-0c8b-413e-9442-7912053a5bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:14.755524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1214/2466] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:14.768097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:14.770435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:14.831919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea320-4e0d-4723-bbb3-77212fbc156d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:14.836691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:14.837367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:14.837651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:14.837923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:14.857224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:14.858672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:14.869410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1253/2467] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:15.192168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9906b9-0c8b-413e-9442-7912053a5bf1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:15.202129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9906b9-0c8b-413e-9442-7912053a5bf1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:15.209212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5875dc0c5afc4327988af7c10bf44da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef9b020773284eb09beb585aa5646161', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:15.210149 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:15.210507 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:15.210886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:15.211969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:15.212343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:15.214823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:15.230597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1215/2468] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:15.234841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:15.243927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498b8e-c425-4aac-b1d1-7bca9951c596 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:15.248702 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5875dc0c5afc4327988af7c10bf44da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef9b020773284eb09beb585aa5646161', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:15.249344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:15.250544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:15.250828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:15.251537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:15.253545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:15.288269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1254/2469] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:15 2022] POST /identity/v3/projects => generated 352 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:15.293191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:15.306957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934f9de-1207-44b3-9b34-c61f93dc6d6b tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:15.368249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5875dc0c5afc4327988af7c10bf44da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef9b020773284eb09beb585aa5646161', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:15.368913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:15.369203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:15.369485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:15.370218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:15.370532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:15.372181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:15.383551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1216/2470] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:15.423187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:15.435246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185017f3-6c7c-4dc1-997b-7abdd6a4ce46 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:15.442367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5875dc0c5afc4327988af7c10bf44da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef9b020773284eb09beb585aa5646161', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:15.443624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:15.444321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:15.444708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] PATH_INFO: `/v3/projects/4b404590c0444531917b2ec15165e618` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:15.446841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b404590c0444531917b2ec15165e618)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:15.450028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:15.503982 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b404590c0444531917b2ec15165e618', 'request_id': 'req-4196103b-7de8-4d96-820e-459c30601ba0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.510457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b404590c0444531917b2ec15165e618', 'request_id': 'req-4196103b-7de8-4d96-820e-459c30601ba0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.519801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b404590c0444531917b2ec15165e618', 'request_id': 'req-4196103b-7de8-4d96-820e-459c30601ba0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.530871 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] The token cache is being invalidate because project 4b404590c0444531917b2ec15165e618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:15.531159 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.531826 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4196103b-7de8-4d96-820e-459c30601ba0 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.533464 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1255/2471] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:15 2022] DELETE /identity/v3/projects/4b404590c0444531917b2ec15165e618 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:15.740081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:15.742382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:15.807885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758ee12-fd19-4355-8798-e4f5f2a8ca20 tempest-VolumeQuotaClassesTest-847934724 tempest-VolumeQuotaClassesTest-847934724-project-admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:15.865751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:15.866635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:15.866923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:15.867197 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] PATH_INFO: `/v3/users/9cd7708d99c84f6ab81246f47bc17fec` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:15.868455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd7708d99c84f6ab81246f47bc17fec)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:15.870402 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:15.924238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd7708d99c84f6ab81246f47bc17fec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.931407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd7708d99c84f6ab81246f47bc17fec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.932182 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd7708d99c84f6ab81246f47bc17fec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.943965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd7708d99c84f6ab81246f47bc17fec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.944627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd7708d99c84f6ab81246f47bc17fec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:15.962853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1217/2472] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:15 2022] DELETE /identity/v3/users/9cd7708d99c84f6ab81246f47bc17fec => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:15.967880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:15.968195 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:15.968474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:15.987148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:15.988402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:16.048617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1256/2473] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:16.058946 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:16.060512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:16.118745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8794ea-ab3b-451b-9153-06db043b8342 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:16.123601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:16.124312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:16.124609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:16.124911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:16.136262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:16.137739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:16.148225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1218/2474] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:16.430289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:16.431755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:16.443757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6e493-3924-4182-8829-00c5d7b3fe28 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:16.449119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:16.450258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:16.450539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:16.450812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] PATH_INFO: `/v3/projects/7a412009dd224ce48c11f001593afbba` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:16.452088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a412009dd224ce48c11f001593afbba)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:16.454020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:16.504360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a412009dd224ce48c11f001593afbba', 'request_id': 'req-ef4e7437-d2b2-4dae-8a30-3b60a5207808'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.511933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a412009dd224ce48c11f001593afbba', 'request_id': 'req-ef4e7437-d2b2-4dae-8a30-3b60a5207808'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.521931 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a412009dd224ce48c11f001593afbba', 'request_id': 'req-ef4e7437-d2b2-4dae-8a30-3b60a5207808'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.535091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] The token cache is being invalidate because project 7a412009dd224ce48c11f001593afbba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:16.535377 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.536034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.537694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1257/2475] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:16 2022] DELETE /identity/v3/projects/7a412009dd224ce48c11f001593afbba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:16.541812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:16.552286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc7298-cf00-487b-a8d7-62aec43e12a3 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:16.609950 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:16.610838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:16.611120 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:16.611395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] PATH_INFO: `/v3/users/5875dc0c5afc4327988af7c10bf44da6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:16.612619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5875dc0c5afc4327988af7c10bf44da6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:16.614784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:16.673222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5875dc0c5afc4327988af7c10bf44da6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.680928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5875dc0c5afc4327988af7c10bf44da6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.681635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5875dc0c5afc4327988af7c10bf44da6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.694259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5875dc0c5afc4327988af7c10bf44da6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.694911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-05d05288-55f4-4a8f-b129-93d6d7d48b3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5875dc0c5afc4327988af7c10bf44da6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:16.712376 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1219/2476] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:16 2022] DELETE /identity/v3/users/5875dc0c5afc4327988af7c10bf44da6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:17.252990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.254953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:17.268797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e7437-d2b2-4dae-8a30-3b60a5207808 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.329955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.330825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.331108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.331384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] PATH_INFO: `/v3/projects/ef9b020773284eb09beb585aa5646161` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.332602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9b020773284eb09beb585aa5646161)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:17.335040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:17.390373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9b020773284eb09beb585aa5646161', 'request_id': 'req-e7855a3c-944b-42a1-b4fb-71d642535c1b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:17.396905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9b020773284eb09beb585aa5646161', 'request_id': 'req-e7855a3c-944b-42a1-b4fb-71d642535c1b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:17.407699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9b020773284eb09beb585aa5646161', 'request_id': 'req-e7855a3c-944b-42a1-b4fb-71d642535c1b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:17.419054 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] The token cache is being invalidate because project ef9b020773284eb09beb585aa5646161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:17.419341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:17.420034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e7855a3c-944b-42a1-b4fb-71d642535c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:17.421602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1258/2477] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:17 2022] DELETE /identity/v3/projects/ef9b020773284eb09beb585aa5646161 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:17.426903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe935-4e4a-4d6d-bd03-e8927de0752e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.427181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe935-4e4a-4d6d-bd03-e8927de0752e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.427469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fe935-4e4a-4d6d-bd03-e8927de0752e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.446995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5c4fe935-4e4a-4d6d-bd03-e8927de0752e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:17.448180 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5c4fe935-4e4a-4d6d-bd03-e8927de0752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:17.519270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1220/2478] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:17.528519 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd446-7bee-4c90-a350-9962bc6d7842 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.529028 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd446-7bee-4c90-a350-9962bc6d7842 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.529125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd446-7bee-4c90-a350-9962bc6d7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.548367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b85dd446-7bee-4c90-a350-9962bc6d7842 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:17.549579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b85dd446-7bee-4c90-a350-9962bc6d7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:17.558924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1259/2479] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:17.563550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fe935-4e4a-4d6d-bd03-e8927de0752e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.574292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fe935-4e4a-4d6d-bd03-e8927de0752e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.580369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.581033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.581315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.581574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.582309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:17.582606 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:17.584513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:17.597600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1221/2480] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:17.602480 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd446-7bee-4c90-a350-9962bc6d7842 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.611968 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd446-7bee-4c90-a350-9962bc6d7842 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.617661 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.618356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.618642 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.618920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.619618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:17.621572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:17.650274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1260/2481] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:17 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:17.654355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.665001 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e13cff-1c94-4073-b9c8-213652b5d29b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.724779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.725787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.726072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.726350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.727044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:17.729045 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:17.754453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1222/2482] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:17 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:17.758716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.769087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8f001-6475-45ca-b8d3-318242dcf1eb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.774226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.774900 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.775185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.775461 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.776293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:17.777889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:17.788370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1261/2483] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:17.792682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.803454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cad34-4475-4a91-9650-110e788405fd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.808504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.809705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.809705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.809705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.810432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:17.812088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:17.825969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1223/2484] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:17.827185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.837482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0508-32f8-48f4-ab03-c2268e715463 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.843240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7df0d3-5aa0-4aa4-a635-d57825d6b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.844244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7df0d3-5aa0-4aa4-a635-d57825d6b745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.844585 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7df0d3-5aa0-4aa4-a635-d57825d6b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.844920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7df0d3-5aa0-4aa4-a635-d57825d6b745 admin admin] PATH_INFO: `/v3/projects/21cf6033de294bac82085ebe3f1cecc8/users/814b6bd6876441da821807885b0654ae/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.855572 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.857405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:17.861216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7df0d3-5aa0-4aa4-a635-d57825d6b745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cf6033de294bac82085ebe3f1cecc8, user_id=814b6bd6876441da821807885b0654ae, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:17.863856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7df0d3-5aa0-4aa4-a635-d57825d6b745 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:17.878733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1262/2485] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:17 2022] PUT /identity/v3/projects/21cf6033de294bac82085ebe3f1cecc8/users/814b6bd6876441da821807885b0654ae/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:17.889085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.889371 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.889646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.915617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] MFA Rules not processed for user `814b6bd6876441da821807885b0654ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:17.916597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2807108-45e4-4e65-a235-bd916e5d244b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:17.916841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:17.966161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:17.966816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:17.967095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:17.967364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:17.969156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:17.980222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1263/2486] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:04:17.991755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:17.993323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:18.042490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:18.044004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:18.048739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19447-b1a2-41c0-a961-eb93cc85ae3b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:18.053152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:18.053812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:18.054100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:18.054382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:18.054804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1224/2487] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:18.063940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:18.065390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:18.074375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1264/2488] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:04:28.625213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:28.626666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:28.687863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49564d0e-0e11-4755-9ae0-862dd7fe0219 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:28.692240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:28.692882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:28.693138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:28.693405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:28.695289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:28.771328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:28.773602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:28.784841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1225/2489] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:32.129313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:32.130788 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:32.146407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ef3a6-2aa9-4787-bef0-0376bc00c07f service glance] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:32.151180 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:32.152369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.152804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.153078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] PATH_INFO: `/v3/users/1ded6e90b10949dcb921119073f2d26a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.167604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ded6e90b10949dcb921119073f2d26a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:32.169649 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:32.223185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ded6e90b10949dcb921119073f2d26a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.235249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ded6e90b10949dcb921119073f2d26a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.248730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ded6e90b10949dcb921119073f2d26a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.255862 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ded6e90b10949dcb921119073f2d26a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.256623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ef1b8a8-35f5-4160-ba10-39546a84dbd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ded6e90b10949dcb921119073f2d26a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.262778 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1265/2490] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:32 2022] DELETE /identity/v3/users/1ded6e90b10949dcb921119073f2d26a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:32.438389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:32.452227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6e8d-8b3f-40f7-b33c-a8790dda5428 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:32.511575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:32.512604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.512958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.513298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] PATH_INFO: `/v3/projects/8ff6bdb0a99948698dc413c12b120b61` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.525050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff6bdb0a99948698dc413c12b120b61)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:32.527365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:32.576930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff6bdb0a99948698dc413c12b120b61', 'request_id': 'req-46ba5a39-ce62-4629-8678-24452414977d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.583531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff6bdb0a99948698dc413c12b120b61', 'request_id': 'req-46ba5a39-ce62-4629-8678-24452414977d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.593086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff6bdb0a99948698dc413c12b120b61', 'request_id': 'req-46ba5a39-ce62-4629-8678-24452414977d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.604738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] The token cache is being invalidate because project 8ff6bdb0a99948698dc413c12b120b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:32.605239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.606346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ba5a39-ce62-4629-8678-24452414977d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:32.607971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1226/2491] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:32 2022] DELETE /identity/v3/projects/8ff6bdb0a99948698dc413c12b120b61 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:32.613036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166941-4520-4c20-8a40-33e870e25995 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.613358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166941-4520-4c20-8a40-33e870e25995 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.613584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166941-4520-4c20-8a40-33e870e25995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.632771 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7b166941-4520-4c20-8a40-33e870e25995 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:32.633976 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7b166941-4520-4c20-8a40-33e870e25995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:32.690781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1266/2492] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:32.699484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994782-22a2-4417-b76b-7fc7d8278124 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.699773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994782-22a2-4417-b76b-7fc7d8278124 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.700083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994782-22a2-4417-b76b-7fc7d8278124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.719088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-70994782-22a2-4417-b76b-7fc7d8278124 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:32.720306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-70994782-22a2-4417-b76b-7fc7d8278124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:32.728791 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1227/2493] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:32.733932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166941-4520-4c20-8a40-33e870e25995 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:32.743922 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166941-4520-4c20-8a40-33e870e25995 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:32.749463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:32.750120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.750404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.750680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.751447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:32.751751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:32.753419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:32.765224 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1267/2494] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:32.769971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994782-22a2-4417-b76b-7fc7d8278124 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:32.783314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994782-22a2-4417-b76b-7fc7d8278124 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:32.790891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:32.791794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.792085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.792753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.793239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:32.795273 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:32.824404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1228/2495] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:32 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:04:32.828666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:32.838930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c35da-bd5e-4e91-b68e-f3ba535ad2ab admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:32.903026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:32.903708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.904002 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.904308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.904993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:32.906916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:32.929150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1268/2496] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:32 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:32.933561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:32.945030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d074-b949-4052-8f96-7ec301f18b42 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:32.951000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:32.951677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.951991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.952261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.952996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:32.954612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:32.964929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1229/2497] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:32.969042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:32.979338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64885830-72c4-4f2a-a7e1-b4b0efae4354 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:32.985168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06086d9d-fe27-46a9-bed0-62eadf458b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:32.985832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06086d9d-fe27-46a9-bed0-62eadf458b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:32.986116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06086d9d-fe27-46a9-bed0-62eadf458b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:32.986388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06086d9d-fe27-46a9-bed0-62eadf458b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:32.987118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06086d9d-fe27-46a9-bed0-62eadf458b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:32.988748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06086d9d-fe27-46a9-bed0-62eadf458b4e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:33.000676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1269/2498] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:33.005148 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:33.016493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176a3e5-f52f-47b5-a02f-69bdd6782a5d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:33.022751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:33.023647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:33.023962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:33.024242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] PATH_INFO: `/v3/projects/3071efd93e1747bbb2ba7f5bfdb5464a/users/8b9bf8ffc56140849ed6a162de4bca39/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:33.041174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3071efd93e1747bbb2ba7f5bfdb5464a, user_id=8b9bf8ffc56140849ed6a162de4bca39, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:33.044037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:33.060366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1230/2499] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:33 2022] PUT /identity/v3/projects/3071efd93e1747bbb2ba7f5bfdb5464a/users/8b9bf8ffc56140849ed6a162de4bca39/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:33.075547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb360-e6e8-4348-adf1-5240878875f6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:33.075772 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb360-e6e8-4348-adf1-5240878875f6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:33.076075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb360-e6e8-4348-adf1-5240878875f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:33.103658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-49ecb360-e6e8-4348-adf1-5240878875f6 None None] MFA Rules not processed for user `8b9bf8ffc56140849ed6a162de4bca39`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:33.104988 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-49ecb360-e6e8-4348-adf1-5240878875f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:33.168785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1270/2500] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:04:33.180400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:33.182629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:33.269007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bb74-9879-4303-b538-3a654fc382f0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:33.276349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeae17-54f0-4a5c-9651-ffc2a8b875c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:33.277237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeae17-54f0-4a5c-9651-ffc2a8b875c9 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:33.277497 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeae17-54f0-4a5c-9651-ffc2a8b875c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:33.277809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeae17-54f0-4a5c-9651-ffc2a8b875c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:33.286464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeae17-54f0-4a5c-9651-ffc2a8b875c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:33.288145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeae17-54f0-4a5c-9651-ffc2a8b875c9 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:33.297760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1231/2501] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:33.498226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecb360-e6e8-4348-adf1-5240878875f6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:33.566741 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecb360-e6e8-4348-adf1-5240878875f6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:33.572437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:33.573321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:33.573638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:33.573918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] PATH_INFO: `/v3/users/8b9bf8ffc56140849ed6a162de4bca39` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:33.575124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9bf8ffc56140849ed6a162de4bca39)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:33.577205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:33.625511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9bf8ffc56140849ed6a162de4bca39'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:33.634341 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9bf8ffc56140849ed6a162de4bca39'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:33.645849 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9bf8ffc56140849ed6a162de4bca39'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:33.652780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9bf8ffc56140849ed6a162de4bca39'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:33.653410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9bf8ffc56140849ed6a162de4bca39'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:33.659345 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1271/2502] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:33 2022] DELETE /identity/v3/users/8b9bf8ffc56140849ed6a162de4bca39 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:33.664119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:33.664604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:33.664697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:33.682849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:33.684070 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:33.746733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1232/2503] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:33.756717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:33.758462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:33.814416 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f658f-1307-4a6b-ad19-b33102ef8594 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:33.818742 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdc972-838f-41a7-b0d3-f36216f1b199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:33.819382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdc972-838f-41a7-b0d3-f36216f1b199 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:33.819662 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdc972-838f-41a7-b0d3-f36216f1b199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:33.819955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdc972-838f-41a7-b0d3-f36216f1b199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:33.829156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdc972-838f-41a7-b0d3-f36216f1b199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:33.830539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdc972-838f-41a7-b0d3-f36216f1b199 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:33.840222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1272/2504] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:34.115806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.117396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:34.130248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c616ae6-11f3-4f96-8d6e-7f559c70d185 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.136301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.137721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.138011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.138322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] PATH_INFO: `/v3/projects/3071efd93e1747bbb2ba7f5bfdb5464a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.139719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3071efd93e1747bbb2ba7f5bfdb5464a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.141771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.190665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3071efd93e1747bbb2ba7f5bfdb5464a', 'request_id': 'req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:34.196872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3071efd93e1747bbb2ba7f5bfdb5464a', 'request_id': 'req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:34.207002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3071efd93e1747bbb2ba7f5bfdb5464a', 'request_id': 'req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:34.217662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] The token cache is being invalidate because project 3071efd93e1747bbb2ba7f5bfdb5464a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:34.217965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:34.218608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d80bcf6-62d0-4f3f-9911-b55c23a17e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:34.220254 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1233/2505] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:34 2022] DELETE /identity/v3/projects/3071efd93e1747bbb2ba7f5bfdb5464a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:34.225621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e321-6fe9-4063-858b-e9d076efc9c4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.226158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e321-6fe9-4063-858b-e9d076efc9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.226158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e321-6fe9-4063-858b-e9d076efc9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.244319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-74a6e321-6fe9-4063-858b-e9d076efc9c4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:34.245498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-74a6e321-6fe9-4063-858b-e9d076efc9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:34.311680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1273/2506] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:34.319588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757119c-6cc3-4fd0-b130-16b237814a64 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.319891 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757119c-6cc3-4fd0-b130-16b237814a64 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.320208 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757119c-6cc3-4fd0-b130-16b237814a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.338940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0757119c-6cc3-4fd0-b130-16b237814a64 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:34.340304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0757119c-6cc3-4fd0-b130-16b237814a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:34.348624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1234/2507] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:34.354325 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e321-6fe9-4063-858b-e9d076efc9c4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.363997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e321-6fe9-4063-858b-e9d076efc9c4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.368439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.369096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.369381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.369660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.370391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:34.370696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.372348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.383560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1274/2508] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:34.388226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757119c-6cc3-4fd0-b130-16b237814a64 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.398677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757119c-6cc3-4fd0-b130-16b237814a64 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.404643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.405318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.405594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.405862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.406545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.408503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.443949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1235/2509] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:34 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:04:34.448056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.458084 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c10e-0212-46af-a114-70fc67763c15 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.516829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.517510 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.517793 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.518068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.518766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.520732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.543350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1275/2510] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:34 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:34.547704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.559532 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae992d8-b9b0-4197-8533-cfbaffd06971 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.565207 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.565886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.566171 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.566445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.567241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.568895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.581051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1236/2511] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:34.585036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.595092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5c0a-e927-4a6e-a33a-e004d3ac4d15 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.600456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd01081-ad73-4dc1-863a-d614ac5b54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.601117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01081-ad73-4dc1-863a-d614ac5b54a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.601398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01081-ad73-4dc1-863a-d614ac5b54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.601674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01081-ad73-4dc1-863a-d614ac5b54a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.602406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd01081-ad73-4dc1-863a-d614ac5b54a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.604046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd01081-ad73-4dc1-863a-d614ac5b54a2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.614078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1276/2512] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:34.619653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.629766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5796d-acab-4ff8-be19-4ea48e6162ab admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.634683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.635561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.635838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.636152 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] PATH_INFO: `/v3/projects/046a1d05336e4b8dba70443f1afc2b75/users/c8fb9a9f5d614288b2487c48de5f7103/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.651146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=046a1d05336e4b8dba70443f1afc2b75, user_id=c8fb9a9f5d614288b2487c48de5f7103, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.653971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.674113 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1237/2513] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:34 2022] PUT /identity/v3/projects/046a1d05336e4b8dba70443f1afc2b75/users/c8fb9a9f5d614288b2487c48de5f7103/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:34.686056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a2fa-b3aa-4f9d-a2da-2ba44ab2d9d5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.686351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a2fa-b3aa-4f9d-a2da-2ba44ab2d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.686630 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a2fa-b3aa-4f9d-a2da-2ba44ab2d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.716106 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d713a2fa-b3aa-4f9d-a2da-2ba44ab2d9d5 None None] MFA Rules not processed for user `c8fb9a9f5d614288b2487c48de5f7103`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:34.717328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d713a2fa-b3aa-4f9d-a2da-2ba44ab2d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:34.783090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1277/2514] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:34.787774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.848142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5911b4-177e-4617-9a84-3244496170dd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.856918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.857886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.858329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.858756 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.859760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.862850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.894595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1238/2515] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:34 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:34.898795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713a2fa-b3aa-4f9d-a2da-2ba44ab2d9d5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:34.910355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713a2fa-b3aa-4f9d-a2da-2ba44ab2d9d5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:34.969651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:34.970323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:34.970609 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:34.970883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:34.971566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:34.973540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:34.997485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1278/2516] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:34 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:35.001702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:35.014032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b129842-4d91-41a0-85ab-4324fe15c623 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:35.018734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:35.019401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:35.019701 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:35.019992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:35.020724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:35.022347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:35.032884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1239/2517] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:35.037250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:35.048597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed389bb-2563-44cd-a5a9-fa539e4ebb8a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:35.055116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:35.056045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:35.056337 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:35.056607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] PATH_INFO: `/v3/projects/f841e07f8c7943578cb738962ccad613/users/9711e592c6014fccba91ae31e8a6f4b4/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:35.073137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f841e07f8c7943578cb738962ccad613, user_id=9711e592c6014fccba91ae31e8a6f4b4, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:35.075899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:35.091134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1279/2518] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:35 2022] PUT /identity/v3/projects/f841e07f8c7943578cb738962ccad613/users/9711e592c6014fccba91ae31e8a6f4b4/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:35.096090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:35.109925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19bb1-ab20-4e30-a874-deb4a3712d3d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:35.167096 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17642db-e8c5-49da-a26e-e8cd79e6bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:35.168062 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17642db-e8c5-49da-a26e-e8cd79e6bee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:35.168368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17642db-e8c5-49da-a26e-e8cd79e6bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:35.168549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17642db-e8c5-49da-a26e-e8cd79e6bee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:35.169292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17642db-e8c5-49da-a26e-e8cd79e6bee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:35.170956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17642db-e8c5-49da-a26e-e8cd79e6bee0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:35.181083 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1240/2519] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:35.186217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:35.201339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702d065-4b63-45fd-bd8d-46b47f59c455 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:35.206395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:35.207289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:35.207576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:35.207841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] PATH_INFO: `/v3/projects/f841e07f8c7943578cb738962ccad613/users/9711e592c6014fccba91ae31e8a6f4b4/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:35.209887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f841e07f8c7943578cb738962ccad613, user_id=9711e592c6014fccba91ae31e8a6f4b4, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:35.212591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:35.223160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1280/2520] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:35 2022] PUT /identity/v3/projects/f841e07f8c7943578cb738962ccad613/users/9711e592c6014fccba91ae31e8a6f4b4/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:35.233997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83dff9-f1c1-4545-bdaf-2e0df008fc2b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:35.234317 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83dff9-f1c1-4545-bdaf-2e0df008fc2b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:35.234601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83dff9-f1c1-4545-bdaf-2e0df008fc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:35.263268 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fa83dff9-f1c1-4545-bdaf-2e0df008fc2b None None] MFA Rules not processed for user `9711e592c6014fccba91ae31e8a6f4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:35.264531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fa83dff9-f1c1-4545-bdaf-2e0df008fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:35.338395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1241/2521] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:35.351223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:35.353220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:35.413305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610957e-ea28-424a-8d09-a79c0183dde8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:35.417070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04ab13-360e-4186-814a-ea19eaf45e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:35.417850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ab13-360e-4186-814a-ea19eaf45e7e service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:35.418060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ab13-360e-4186-814a-ea19eaf45e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:35.418284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ab13-360e-4186-814a-ea19eaf45e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:35.427284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04ab13-360e-4186-814a-ea19eaf45e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:35.428754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04ab13-360e-4186-814a-ea19eaf45e7e service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:35.438261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1281/2522] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:36.873313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83dff9-f1c1-4545-bdaf-2e0df008fc2b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:36.941025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83dff9-f1c1-4545-bdaf-2e0df008fc2b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:36.946599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:36.947480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:36.947764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:36.948078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] PATH_INFO: `/v3/users/c8fb9a9f5d614288b2487c48de5f7103` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:36.949341 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fb9a9f5d614288b2487c48de5f7103)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:36.951415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:37.007588 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fb9a9f5d614288b2487c48de5f7103'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.017459 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fb9a9f5d614288b2487c48de5f7103'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.018615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fb9a9f5d614288b2487c48de5f7103'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.034918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fb9a9f5d614288b2487c48de5f7103'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.035629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fb9a9f5d614288b2487c48de5f7103'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.051737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1242/2523] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:36 2022] DELETE /identity/v3/users/c8fb9a9f5d614288b2487c48de5f7103 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:37.056658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:37.057147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:37.057267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:37.075659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:37.076918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:37.137357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1282/2524] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:37.148980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:37.151271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:37.217818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54854a-2b2e-4d01-bc03-9e4a0ae31d04 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:37.222383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:37.223042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:37.223328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:37.223609 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:37.233584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:37.235076 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:37.244709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1243/2525] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:37.529278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:37.530732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:37.543458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f2890-637e-49ba-9d7a-6d0804dc89fb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:37.548467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:37.549370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:37.549652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:37.550290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] PATH_INFO: `/v3/projects/046a1d05336e4b8dba70443f1afc2b75` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:37.551149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046a1d05336e4b8dba70443f1afc2b75)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:37.553130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:37.600145 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046a1d05336e4b8dba70443f1afc2b75', 'request_id': 'req-2c712901-61cb-4850-81b7-f0f649b2f3f5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.606457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046a1d05336e4b8dba70443f1afc2b75', 'request_id': 'req-2c712901-61cb-4850-81b7-f0f649b2f3f5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.616150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046a1d05336e4b8dba70443f1afc2b75', 'request_id': 'req-2c712901-61cb-4850-81b7-f0f649b2f3f5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.626647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] The token cache is being invalidate because project 046a1d05336e4b8dba70443f1afc2b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:37.626933 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.627547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.629117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1283/2526] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:37 2022] DELETE /identity/v3/projects/046a1d05336e4b8dba70443f1afc2b75 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:37.633287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:37.642928 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6473395-5815-4721-8c9d-85ab62609b39 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:37.701798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:37.702668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:37.702945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:37.703215 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] PATH_INFO: `/v3/users/9711e592c6014fccba91ae31e8a6f4b4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:37.704531 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9711e592c6014fccba91ae31e8a6f4b4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:37.706475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:37.761859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9711e592c6014fccba91ae31e8a6f4b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.768415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9711e592c6014fccba91ae31e8a6f4b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.768995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9711e592c6014fccba91ae31e8a6f4b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.781355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9711e592c6014fccba91ae31e8a6f4b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.782057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e04ca9c2-db08-4bec-a56e-e4736e38819b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9711e592c6014fccba91ae31e8a6f4b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:37.797605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1244/2527] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:37 2022] DELETE /identity/v3/users/9711e592c6014fccba91ae31e8a6f4b4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:38.066932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.068462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:38.082399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c712901-61cb-4850-81b7-f0f649b2f3f5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.148122 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.149034 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.149315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.149591 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] PATH_INFO: `/v3/projects/f841e07f8c7943578cb738962ccad613` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.150946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f841e07f8c7943578cb738962ccad613)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.153022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.211811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f841e07f8c7943578cb738962ccad613', 'request_id': 'req-ce9acab7-6a8f-49f1-81c4-53193a512f63'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:38.218451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f841e07f8c7943578cb738962ccad613', 'request_id': 'req-ce9acab7-6a8f-49f1-81c4-53193a512f63'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:38.228807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f841e07f8c7943578cb738962ccad613', 'request_id': 'req-ce9acab7-6a8f-49f1-81c4-53193a512f63'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:38.240266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] The token cache is being invalidate because project f841e07f8c7943578cb738962ccad613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:38.240554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:38.241251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce9acab7-6a8f-49f1-81c4-53193a512f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:38.242898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1284/2528] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:38 2022] DELETE /identity/v3/projects/f841e07f8c7943578cb738962ccad613 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:38.247983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f03d1-2e7c-4130-b2fc-ba5ca5134ece None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.248463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f03d1-2e7c-4130-b2fc-ba5ca5134ece None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.248579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f03d1-2e7c-4130-b2fc-ba5ca5134ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.268264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6c2f03d1-2e7c-4130-b2fc-ba5ca5134ece None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:38.269464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6c2f03d1-2e7c-4130-b2fc-ba5ca5134ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:38.327510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1245/2529] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:38.336284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c89b-d220-40f7-b7d3-979bcb180e3d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.336570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c89b-d220-40f7-b7d3-979bcb180e3d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.336845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c89b-d220-40f7-b7d3-979bcb180e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.356494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d698c89b-d220-40f7-b7d3-979bcb180e3d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:38.357691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d698c89b-d220-40f7-b7d3-979bcb180e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:38.366472 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1285/2530] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:38.370653 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f03d1-2e7c-4130-b2fc-ba5ca5134ece None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.380550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f03d1-2e7c-4130-b2fc-ba5ca5134ece None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.385306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.385958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.386235 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.386506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.387221 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:38.387524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.389158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.400390 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1246/2531] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:38.405140 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c89b-d220-40f7-b7d3-979bcb180e3d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.414764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c89b-d220-40f7-b7d3-979bcb180e3d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.420361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.421006 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.421283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.421553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.422243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.424191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.454614 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1286/2532] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:38 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:38.460276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.471375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fdc99-6918-4c4f-97b0-c4c1304b327c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.533466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.534142 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.534540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.534817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.535530 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.537652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.560478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1247/2533] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:38 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:38.564832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.575556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b1a1-0915-4f84-a7bc-5b6e8bf64755 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.580638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.581240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.581520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.581785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.582514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.584191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.594932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1287/2534] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:38.599173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.609986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa40f3-32cf-4036-b010-5595bd2f945d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.615336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56538-78a0-4870-a555-58ccba161abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.616031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56538-78a0-4870-a555-58ccba161abe admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.616314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56538-78a0-4870-a555-58ccba161abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.616590 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56538-78a0-4870-a555-58ccba161abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.617342 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf56538-78a0-4870-a555-58ccba161abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.618985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf56538-78a0-4870-a555-58ccba161abe admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.629146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1248/2535] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:38.633440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.644463 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c64c80-d547-470b-8248-3c4f32fa2180 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.649443 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.650323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.650605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.650880 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] PATH_INFO: `/v3/projects/3152ba0fa81f4ce8913d772f3d2ea2b2/users/20d1b04139444a4c9490c2e58ba16940/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.666206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3152ba0fa81f4ce8913d772f3d2ea2b2, user_id=20d1b04139444a4c9490c2e58ba16940, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.669086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.687640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1288/2536] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:38 2022] PUT /identity/v3/projects/3152ba0fa81f4ce8913d772f3d2ea2b2/users/20d1b04139444a4c9490c2e58ba16940/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:38.700570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b3ed-03a5-4d88-b6e6-0491f6edc877 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.700965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b3ed-03a5-4d88-b6e6-0491f6edc877 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.701255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b3ed-03a5-4d88-b6e6-0491f6edc877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.728405 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8d45b3ed-03a5-4d88-b6e6-0491f6edc877 None None] MFA Rules not processed for user `20d1b04139444a4c9490c2e58ba16940`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:38.729630 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8d45b3ed-03a5-4d88-b6e6-0491f6edc877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:38.801237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1249/2537] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:38.806088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.881977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1017ea-17cd-422e-b0a6-745ef1c048fb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.887188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.887961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:38.888250 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:38.888517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:38.889203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:38.891101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:38.919813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1289/2538] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:38 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:38.923920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b3ed-03a5-4d88-b6e6-0491f6edc877 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:38.934983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b3ed-03a5-4d88-b6e6-0491f6edc877 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:38.996991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:38.999616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.000147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.000709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.001794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:39.005316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:39.030212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1250/2539] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:38 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:39.035010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:39.048440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8274e1-3e41-47dd-bc55-7c40331ba588 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:39.053312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:39.053966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.054247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.054520 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.055241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:39.056874 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:39.067233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1290/2540] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:04:39.072660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:39.084327 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b232a-0d25-4fcc-99b5-3d9bb3b9ad25 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:39.089862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:39.091150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.091150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.091403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] PATH_INFO: `/v3/projects/f10811b47b5d4bd392dfc26587abe3c7/users/f2293a23ce4c48f19f1343dae75f472a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.107829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10811b47b5d4bd392dfc26587abe3c7, user_id=f2293a23ce4c48f19f1343dae75f472a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:39.110594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:39.127284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1251/2541] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:39 2022] PUT /identity/v3/projects/f10811b47b5d4bd392dfc26587abe3c7/users/f2293a23ce4c48f19f1343dae75f472a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:39.131429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:39.142019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9a575-bdd1-4e1d-9587-1fa2845f55ab admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:39.200523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef31085-6cd2-44c6-99f7-7c0af6674d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:39.200987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31085-6cd2-44c6-99f7-7c0af6674d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.201266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31085-6cd2-44c6-99f7-7c0af6674d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.201534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31085-6cd2-44c6-99f7-7c0af6674d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.202264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef31085-6cd2-44c6-99f7-7c0af6674d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:39.203861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef31085-6cd2-44c6-99f7-7c0af6674d79 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:39.214671 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1291/2542] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:39.221011 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:39.236616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b119a-648d-4a1f-9d1e-9d0268c15727 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:39.244567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:39.245813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.246157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.246434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] PATH_INFO: `/v3/projects/f10811b47b5d4bd392dfc26587abe3c7/users/f2293a23ce4c48f19f1343dae75f472a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.248894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10811b47b5d4bd392dfc26587abe3c7, user_id=f2293a23ce4c48f19f1343dae75f472a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:39.251560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:39.262863 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1252/2543] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:39 2022] PUT /identity/v3/projects/f10811b47b5d4bd392dfc26587abe3c7/users/f2293a23ce4c48f19f1343dae75f472a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:39.273375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.273848 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.274096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.311268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] MFA Rules not processed for user `f2293a23ce4c48f19f1343dae75f472a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:39.312528 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:39.395417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1292/2544] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:39.407140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:39.409285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:39.471730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce4563-7cb7-4287-ab72-69cc81c3aba1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:39.477586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:39.478548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.478885 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.479175 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.493933 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:39.496205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:39.507548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1253/2545] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:39.585182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:39.586618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:39.599156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7e694-8ab7-4caa-be88-b475b513a244 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:39.603233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814a5a-f072-45c2-8d8d-8d08da5c0ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:39.603904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814a5a-f072-45c2-8d8d-8d08da5c0ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:39.604194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814a5a-f072-45c2-8d8d-8d08da5c0ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:39.604471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814a5a-f072-45c2-8d8d-8d08da5c0ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:39.671234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b814a5a-f072-45c2-8d8d-8d08da5c0ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:39.672652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b814a5a-f072-45c2-8d8d-8d08da5c0ad1 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:39.681998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1293/2546] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:39.963503 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:40.026456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe9bba-8571-4423-a24f-5080641cd7ce service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:40.031537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:40.032448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:40.032727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:40.033003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] PATH_INFO: `/v3/users/20d1b04139444a4c9490c2e58ba16940` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:40.034210 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d1b04139444a4c9490c2e58ba16940)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:40.036174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:40.091381 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d1b04139444a4c9490c2e58ba16940'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.099223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d1b04139444a4c9490c2e58ba16940'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.100232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d1b04139444a4c9490c2e58ba16940'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.112265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d1b04139444a4c9490c2e58ba16940'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.112934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d1b04139444a4c9490c2e58ba16940'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.127957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1254/2547] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:39 2022] DELETE /identity/v3/users/20d1b04139444a4c9490c2e58ba16940 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:40.132351 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:40.132855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:40.132952 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:40.151042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:40.152284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:40.210720 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1294/2548] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:04:40.220745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:40.222243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:40.280569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1112fcc-4a1b-4cca-9190-036a6ef4080d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:40.286692 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:40.287707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:40.288188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:40.288618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:40.302231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:40.303690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:40.314302 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1255/2549] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:40.627280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:40.628911 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:40.649089 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb81d3-994d-456f-83d7-848076731f4e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:40.654522 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:40.655850 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:40.656163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:40.656439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] PATH_INFO: `/v3/projects/3152ba0fa81f4ce8913d772f3d2ea2b2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:40.657639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3152ba0fa81f4ce8913d772f3d2ea2b2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:40.659558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:40.706536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3152ba0fa81f4ce8913d772f3d2ea2b2', 'request_id': 'req-2664403b-5735-4c74-807b-b2c0a3a60881'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.713219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3152ba0fa81f4ce8913d772f3d2ea2b2', 'request_id': 'req-2664403b-5735-4c74-807b-b2c0a3a60881'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.722206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3152ba0fa81f4ce8913d772f3d2ea2b2', 'request_id': 'req-2664403b-5735-4c74-807b-b2c0a3a60881'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.733732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] The token cache is being invalidate because project 3152ba0fa81f4ce8913d772f3d2ea2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:40.734110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.734997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.736700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1295/2550] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:40 2022] DELETE /identity/v3/projects/3152ba0fa81f4ce8913d772f3d2ea2b2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:40.741619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:40.754544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38463b9d-02b1-4185-9416-c2b628f72bfc service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:40.816561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:40.817429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:40.817714 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:40.817982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] PATH_INFO: `/v3/users/f2293a23ce4c48f19f1343dae75f472a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:40.819168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2293a23ce4c48f19f1343dae75f472a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:40.821135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:40.883555 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2293a23ce4c48f19f1343dae75f472a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.893930 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2293a23ce4c48f19f1343dae75f472a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.894690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2293a23ce4c48f19f1343dae75f472a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.907166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2293a23ce4c48f19f1343dae75f472a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.907966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7f4d74ad-f376-4b9f-a8a6-3861204de88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2293a23ce4c48f19f1343dae75f472a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:40.923784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1256/2551] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:40 2022] DELETE /identity/v3/users/f2293a23ce4c48f19f1343dae75f472a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:41.203815 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.204295 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:41.219679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664403b-5735-4c74-807b-b2c0a3a60881 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:41.281042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:41.281836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.282117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.282391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] PATH_INFO: `/v3/projects/f10811b47b5d4bd392dfc26587abe3c7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.283637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10811b47b5d4bd392dfc26587abe3c7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:41.285786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:41.333302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10811b47b5d4bd392dfc26587abe3c7', 'request_id': 'req-1a9198db-94d1-4674-9a58-b581db4d2473'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:41.339378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10811b47b5d4bd392dfc26587abe3c7', 'request_id': 'req-1a9198db-94d1-4674-9a58-b581db4d2473'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:41.350651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10811b47b5d4bd392dfc26587abe3c7', 'request_id': 'req-1a9198db-94d1-4674-9a58-b581db4d2473'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:41.361269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] The token cache is being invalidate because project f10811b47b5d4bd392dfc26587abe3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:41.361558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:41.362200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1a9198db-94d1-4674-9a58-b581db4d2473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:41.363972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1296/2552] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:41 2022] DELETE /identity/v3/projects/f10811b47b5d4bd392dfc26587abe3c7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:41.369295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b287f4-5f3d-4e38-9fc0-adcbd317a068 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.369893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b287f4-5f3d-4e38-9fc0-adcbd317a068 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.369893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b287f4-5f3d-4e38-9fc0-adcbd317a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.388000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-31b287f4-5f3d-4e38-9fc0-adcbd317a068 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:41.389223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-31b287f4-5f3d-4e38-9fc0-adcbd317a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:41.449917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1257/2553] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:41.461362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34387-907e-4da1-857e-3bd0ddecad72 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.461645 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34387-907e-4da1-857e-3bd0ddecad72 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.461925 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34387-907e-4da1-857e-3bd0ddecad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.482075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7da34387-907e-4da1-857e-3bd0ddecad72 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:41.483254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7da34387-907e-4da1-857e-3bd0ddecad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:41.492756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1297/2554] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:41.497056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b287f4-5f3d-4e38-9fc0-adcbd317a068 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.507689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b287f4-5f3d-4e38-9fc0-adcbd317a068 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:41.512600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:41.513275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.513557 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.513831 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.514585 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:41.515010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:41.516707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:41.528562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1258/2555] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:04:41.533087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da34387-907e-4da1-857e-3bd0ddecad72 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.542475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da34387-907e-4da1-857e-3bd0ddecad72 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:41.548119 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:41.548773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.549079 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.549348 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.550038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:41.551987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:41.580827 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1298/2556] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:41 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:41.586802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.600032 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e95eb-1c11-4fd3-a4d1-c8e1977bf34b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:41.660855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:41.661560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.661851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.662108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.662787 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:41.664767 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:41.689855 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1259/2557] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:41 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:41.690964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.701082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de2187-5b90-4174-809b-53b864867b50 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:41.706367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:41.707038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.707308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.707586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.708381 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:41.710010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:41.721160 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1299/2558] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:41.725403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.736379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de0eda-e8bc-4ae7-8c7c-765aff2ee0a4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:41.741690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fca9d-413b-4192-b908-cdc856c448b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:41.742495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fca9d-413b-4192-b908-cdc856c448b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.742799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fca9d-413b-4192-b908-cdc856c448b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.743284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fca9d-413b-4192-b908-cdc856c448b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.744133 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fca9d-413b-4192-b908-cdc856c448b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:41.746057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fca9d-413b-4192-b908-cdc856c448b7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:41.757330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1260/2559] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:41.761564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.771740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47805c0-3058-419f-8926-f342c3b42f88 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:41.776779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:41.777664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.777942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.778244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] PATH_INFO: `/v3/projects/4196286683114e8bb5c22000307eb362/users/cec98d0a6c6345fb8968301a5f5e18a9/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.794278 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4196286683114e8bb5c22000307eb362, user_id=cec98d0a6c6345fb8968301a5f5e18a9, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:41.797285 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:41.820344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1300/2560] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:41 2022] PUT /identity/v3/projects/4196286683114e8bb5c22000307eb362/users/cec98d0a6c6345fb8968301a5f5e18a9/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:41.823651 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd709fcb-893f-4428-b096-2628bb026241 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:41.825282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd709fcb-893f-4428-b096-2628bb026241 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:41.825282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd709fcb-893f-4428-b096-2628bb026241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:41.851976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dd709fcb-893f-4428-b096-2628bb026241 None None] MFA Rules not processed for user `cec98d0a6c6345fb8968301a5f5e18a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:41.853184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dd709fcb-893f-4428-b096-2628bb026241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:41.915671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1261/2561] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:41.928407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:41.931340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:41.998987 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad495b5-be27-4ae2-88d6-c03138e06c75 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:42.003456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64a7a-ebc2-4c3c-beb5-4a71e248edbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:42.004142 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64a7a-ebc2-4c3c-beb5-4a71e248edbd service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:42.004428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64a7a-ebc2-4c3c-beb5-4a71e248edbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:42.004709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64a7a-ebc2-4c3c-beb5-4a71e248edbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:42.014347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64a7a-ebc2-4c3c-beb5-4a71e248edbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:42.016524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64a7a-ebc2-4c3c-beb5-4a71e248edbd service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:42.030021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1301/2562] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:54.671667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd709fcb-893f-4428-b096-2628bb026241 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:54.745111 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd709fcb-893f-4428-b096-2628bb026241 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:54.751078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:54.752003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:54.752240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:54.752547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] PATH_INFO: `/v3/users/cec98d0a6c6345fb8968301a5f5e18a9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:54.753986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec98d0a6c6345fb8968301a5f5e18a9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:54.755976 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:54.811127 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec98d0a6c6345fb8968301a5f5e18a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:54.818088 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec98d0a6c6345fb8968301a5f5e18a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:54.818789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec98d0a6c6345fb8968301a5f5e18a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:54.832178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec98d0a6c6345fb8968301a5f5e18a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:54.832841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec98d0a6c6345fb8968301a5f5e18a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:54.847910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1262/2563] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:54 2022] DELETE /identity/v3/users/cec98d0a6c6345fb8968301a5f5e18a9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:54.853050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:54.853533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:54.853643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:54.871148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:54.872376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:54.936273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1302/2564] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:54.946962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:54.948648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:55.009660 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28981a1-ccb2-42fb-bcbb-25b2d4109e56 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.013633 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e5c14-e074-423d-a19a-afe6903e3b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.014286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e5c14-e074-423d-a19a-afe6903e3b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.014563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e5c14-e074-423d-a19a-afe6903e3b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.014986 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e5c14-e074-423d-a19a-afe6903e3b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.024642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e5c14-e074-423d-a19a-afe6903e3b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.026068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e5c14-e074-423d-a19a-afe6903e3b55 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.036172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1263/2565] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:55.339161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:55.340740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:55.353994 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c407-e43a-4642-b2a2-785de436123e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.360423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.361433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.361665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.362094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] PATH_INFO: `/v3/projects/4196286683114e8bb5c22000307eb362` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.364336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4196286683114e8bb5c22000307eb362)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.366384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.419478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4196286683114e8bb5c22000307eb362', 'request_id': 'req-243376e3-d34d-461d-b738-4db6532f65e6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:55.425989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4196286683114e8bb5c22000307eb362', 'request_id': 'req-243376e3-d34d-461d-b738-4db6532f65e6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:55.436115 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4196286683114e8bb5c22000307eb362', 'request_id': 'req-243376e3-d34d-461d-b738-4db6532f65e6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:55.447123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] The token cache is being invalidate because project 4196286683114e8bb5c22000307eb362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:55.447386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:55.448102 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-243376e3-d34d-461d-b738-4db6532f65e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:55.449730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1303/2566] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:55 2022] DELETE /identity/v3/projects/4196286683114e8bb5c22000307eb362 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:55.455448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd44f1-50f0-45df-b8ef-da73592ef59c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.455737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd44f1-50f0-45df-b8ef-da73592ef59c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.456056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd44f1-50f0-45df-b8ef-da73592ef59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.475079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0cbd44f1-50f0-45df-b8ef-da73592ef59c None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:55.476356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0cbd44f1-50f0-45df-b8ef-da73592ef59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:55.541189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1264/2567] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:04:55.550077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76ec5-eb5d-4fa1-a928-457a681cedcc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.550392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76ec5-eb5d-4fa1-a928-457a681cedcc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.550697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76ec5-eb5d-4fa1-a928-457a681cedcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.573255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-70a76ec5-eb5d-4fa1-a928-457a681cedcc None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:55.574450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-70a76ec5-eb5d-4fa1-a928-457a681cedcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:55.583618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1304/2568] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:55.588136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd44f1-50f0-45df-b8ef-da73592ef59c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:55.599673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd44f1-50f0-45df-b8ef-da73592ef59c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.605639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.606306 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.606554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.606860 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.607587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:55.607905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.610247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.630731 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1265/2569] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:04:55.635908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76ec5-eb5d-4fa1-a928-457a681cedcc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:55.650268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76ec5-eb5d-4fa1-a928-457a681cedcc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.659372 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.660222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.660512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.660786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.661477 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.663397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.693959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1305/2570] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:55 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:55.698275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:55.708846 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e1717-1830-4f1b-8c08-2df3f54a196d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.776956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.777644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.777929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.778195 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.778883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.780893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.804167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1266/2571] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:55 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:55.808346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:55.819427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3346ec-563a-44c8-b861-a53abc1cf218 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.824392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.825046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.825326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.825597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.826326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.827943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.838287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1306/2572] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:55.842270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:55.853293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fcbd2-cf82-42d4-8c40-2ed9fa7a4c1f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.858681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dbcc0-90ff-425d-8dbc-75ff88bfbbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.859361 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbcc0-90ff-425d-8dbc-75ff88bfbbfd admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.859635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbcc0-90ff-425d-8dbc-75ff88bfbbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.859899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dbcc0-90ff-425d-8dbc-75ff88bfbbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.860656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbcc0-90ff-425d-8dbc-75ff88bfbbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.862240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dbcc0-90ff-425d-8dbc-75ff88bfbbfd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.873024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1267/2573] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:55.877177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:55.887243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf4424-9deb-492a-8762-2eb89c101837 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:55.892178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:55.893050 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.893334 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.893605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] PATH_INFO: `/v3/projects/4484818168ed4b709bc79a714ab95ba5/users/ce07e0e94d0044768d549486b06712ca/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.907914 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4484818168ed4b709bc79a714ab95ba5, user_id=ce07e0e94d0044768d549486b06712ca, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:55.910607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:55.925711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1307/2574] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:55 2022] PUT /identity/v3/projects/4484818168ed4b709bc79a714ab95ba5/users/ce07e0e94d0044768d549486b06712ca/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:04:55.935954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:55.936242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:55.936516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:55.962558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] MFA Rules not processed for user `ce07e0e94d0044768d549486b06712ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:55.963757 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:56.032611 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1268/2575] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:56.044593 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:56.046323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:56.106909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e553911-7b94-46f9-89ed-73e411854baf admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:56.111237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa780ab-c776-47d4-8c64-41dd5356a67c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:56.111912 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa780ab-c776-47d4-8c64-41dd5356a67c service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:56.112185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa780ab-c776-47d4-8c64-41dd5356a67c service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:56.112455 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa780ab-c776-47d4-8c64-41dd5356a67c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:56.121090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa780ab-c776-47d4-8c64-41dd5356a67c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:56.122518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa780ab-c776-47d4-8c64-41dd5356a67c service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:56.131396 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1308/2576] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:58.447261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:58.448931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:58.520550 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751d26f-bd60-4013-9fba-c50449c68692 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:58.526925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:58.527829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:58.528137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:58.528411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] PATH_INFO: `/v3/users/814b6bd6876441da821807885b0654ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:58.529778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814b6bd6876441da821807885b0654ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:58.531751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:58.583836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814b6bd6876441da821807885b0654ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:58.591163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814b6bd6876441da821807885b0654ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:58.591903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814b6bd6876441da821807885b0654ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:58.604656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814b6bd6876441da821807885b0654ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:58.605384 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814b6bd6876441da821807885b0654ae'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:58.621106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1269/2577] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:04:58 2022] DELETE /identity/v3/users/814b6bd6876441da821807885b0654ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:58.625856 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:58.626338 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:58.626556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:58.644578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:58.645766 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:58.707679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1309/2578] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:58.717852 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:58.719322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:58.779979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f394d-401e-4ef6-a18d-95ae29590384 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:58.785734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d8a64-18c4-4fda-9945-858bbf669ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:58.785734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d8a64-18c4-4fda-9945-858bbf669ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:58.785734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d8a64-18c4-4fda-9945-858bbf669ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:58.786135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d8a64-18c4-4fda-9945-858bbf669ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:58.796681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d8a64-18c4-4fda-9945-858bbf669ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:58.798147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d8a64-18c4-4fda-9945-858bbf669ff2 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:58.808450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1270/2579] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:04:59.090220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.091674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:59.111636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671866-1773-40b5-8919-2f27acfcc9be None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.117980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.118902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.119191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.120031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] PATH_INFO: `/v3/projects/21cf6033de294bac82085ebe3f1cecc8` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.121234 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cf6033de294bac82085ebe3f1cecc8)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.123218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.175815 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cf6033de294bac82085ebe3f1cecc8', 'request_id': 'req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:59.182067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cf6033de294bac82085ebe3f1cecc8', 'request_id': 'req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:59.190735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cf6033de294bac82085ebe3f1cecc8', 'request_id': 'req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:59.202622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] The token cache is being invalidate because project 21cf6033de294bac82085ebe3f1cecc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:04:59.202917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:59.203704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-57c4b5ed-0234-41c7-a3b9-dd3be785ab3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:04:59.205619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1310/2580] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:04:59 2022] DELETE /identity/v3/projects/21cf6033de294bac82085ebe3f1cecc8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:59.211490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90750-dc2f-4a4a-b07e-f3214463b52f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.211720 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90750-dc2f-4a4a-b07e-f3214463b52f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.212025 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90750-dc2f-4a4a-b07e-f3214463b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.231608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b4f90750-dc2f-4a4a-b07e-f3214463b52f None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:59.233027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b4f90750-dc2f-4a4a-b07e-f3214463b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:59.298912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1271/2581] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:59.312368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223b164-e9c1-4f38-b70c-834d6750fc74 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.312663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223b164-e9c1-4f38-b70c-834d6750fc74 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.312986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223b164-e9c1-4f38-b70c-834d6750fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.335271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0223b164-e9c1-4f38-b70c-834d6750fc74 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:59.336531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0223b164-e9c1-4f38-b70c-834d6750fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:59.346779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1311/2582] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:59.351721 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90750-dc2f-4a4a-b07e-f3214463b52f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.362198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90750-dc2f-4a4a-b07e-f3214463b52f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.368383 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.369185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.369513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.369783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.370487 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:04:59.370808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.372495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.385666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1272/2583] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:04:59.390319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223b164-e9c1-4f38-b70c-834d6750fc74 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.400710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223b164-e9c1-4f38-b70c-834d6750fc74 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.406666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.407330 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.407617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.407915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.408620 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.410561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.445276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1312/2584] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:04:59 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:59.450292 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.464580 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2174237-ba18-4d73-9cf9-0a75a3b4c06b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.527862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.528604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.528880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.529147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.529829 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.531764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.554751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1273/2585] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:04:59 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:04:59.558978 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.569459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47582323-cf2e-4528-940c-15cfd190d010 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.574677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.575313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.575604 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.575913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.576647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.578254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.589898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1313/2586] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:59.594013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.604766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902557-4c1d-4f9e-8fec-ee667e4465a3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.610163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a0127-9a2a-42f1-85e5-88e4004e84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.610872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a0127-9a2a-42f1-85e5-88e4004e84f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.611177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a0127-9a2a-42f1-85e5-88e4004e84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.611451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a0127-9a2a-42f1-85e5-88e4004e84f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.612250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a0127-9a2a-42f1-85e5-88e4004e84f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.613867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a0127-9a2a-42f1-85e5-88e4004e84f2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.624305 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1274/2587] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:04:59.628612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.639735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a49d-f209-45b0-8523-28ff7fd3569b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.644637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.645529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.645813 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.646081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] PATH_INFO: `/v3/projects/d2bc498dbd674965a795f4ea1e1ba246/users/8a3e1aa1fc2640849e8315f84c98b625/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.664016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bc498dbd674965a795f4ea1e1ba246, user_id=8a3e1aa1fc2640849e8315f84c98b625, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.666703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.685249 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1314/2588] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:04:59 2022] PUT /identity/v3/projects/d2bc498dbd674965a795f4ea1e1ba246/users/8a3e1aa1fc2640849e8315f84c98b625/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:04:59.695934 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a82944-7243-42a1-bd14-8c6497180796 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.696227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a82944-7243-42a1-bd14-8c6497180796 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.696502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a82944-7243-42a1-bd14-8c6497180796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.725618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-61a82944-7243-42a1-bd14-8c6497180796 None None] MFA Rules not processed for user `8a3e1aa1fc2640849e8315f84c98b625`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:04:59.726899 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-61a82944-7243-42a1-bd14-8c6497180796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:59.797833 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1275/2589] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:04:59.804666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:04:59.806681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:04:59.867721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9e1ca-81c7-42c4-86f1-3964ae9e40d7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:04:59.872148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:04:59.872804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:04:59.873101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:04:59.873361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:04:59.882534 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:04:59.884668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:04:59.893977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1315/2590] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:04:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:01.275156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:01.275958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:01.275958 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:01.295512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] MFA Rules not processed for user `8a3e1aa1fc2640849e8315f84c98b625`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:01.296780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:01.304363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1276/2591] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:03.898172 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:03.899802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:03.965790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc29510-b743-4b7f-b870-96bc75db479c service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:03.972774 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:03.973539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:03.974266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:03.974402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:03.976583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:03.993833 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:03.995300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:04.003945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1316/2592] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:04.662158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:04.663597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:04.760536 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f5389-9abf-4d20-adaf-a9fe9f62e2f7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:04.767432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d757ae-f046-4871-9891-13dd7a2c6ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:04.768129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d757ae-f046-4871-9891-13dd7a2c6ff3 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:04.768410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d757ae-f046-4871-9891-13dd7a2c6ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:04.768681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d757ae-f046-4871-9891-13dd7a2c6ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:04.770445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-53d757ae-f046-4871-9891-13dd7a2c6ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:04.784880 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d757ae-f046-4871-9891-13dd7a2c6ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:04.787815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d757ae-f046-4871-9891-13dd7a2c6ff3 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:04.800575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1277/2593] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:16.245107 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:16.254293 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120ae91-9f30-440f-a885-0e6c91c2fdd3 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:16.258607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:16.259215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:16.259496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:16.259770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:16.261731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:16.341019 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:16.342374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:16.352975 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1317/2594] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:18.573801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1eec-3489-44f8-b730-cf07ef0eb949 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:18.574865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1eec-3489-44f8-b730-cf07ef0eb949 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:18.575161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1eec-3489-44f8-b730-cf07ef0eb949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:18.593568 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ecae1eec-3489-44f8-b730-cf07ef0eb949 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:18.594792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ecae1eec-3489-44f8-b730-cf07ef0eb949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:18.655948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1278/2595] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:18.732624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:18.735321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:18.821682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979aaf8-b1d7-4690-aa73-6a356e0591fc service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:18.826878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:18.827531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:18.828065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:18.828508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:18.837749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:18.839491 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:18.850495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1318/2596] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:05:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 15:05:19.416418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38664-9bec-4ef0-88c3-5526ab3514da None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:19.416735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38664-9bec-4ef0-88c3-5526ab3514da None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:19.417020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38664-9bec-4ef0-88c3-5526ab3514da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:19.437551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5ec38664-9bec-4ef0-88c3-5526ab3514da None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:19.439276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5ec38664-9bec-4ef0-88c3-5526ab3514da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:19.448761 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1279/2597] 10.222.0.99 () {58 vars in 967 bytes} [Fri May 13 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:19.461501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:19.474384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772825e-4635-4068-9a47-b759ea5cde1a service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:19.479942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:19.480612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:19.480876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:19.481344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:19.490588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:19.492222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:19.503810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1319/2598] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:05:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:05:19.723762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25bafe-c379-4947-a446-f57e843c899a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:19.724665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25bafe-c379-4947-a446-f57e843c899a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:19.725105 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25bafe-c379-4947-a446-f57e843c899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:19.745114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5a25bafe-c379-4947-a446-f57e843c899a None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:19.747943 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5a25bafe-c379-4947-a446-f57e843c899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:19.762723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1280/2599] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:19.770711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:19.783955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596acf1-d105-42f4-9b57-45f7bb7bff30 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:19.792387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:19.793456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:19.794068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:19.794651 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:19.807897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:19.809760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:19.833587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1320/2600] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:05:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:05:20.390396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:20.390622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:20.390862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:20.416575 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:20.417824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:20.435759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1281/2601] 10.222.0.99 () {58 vars in 967 bytes} [Fri May 13 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:20.450098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:20.461094 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087a16c-e995-4bba-a456-90b2d5693ae1 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:20.467622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:20.468210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:20.468660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:20.468934 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:20.484156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:20.485980 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:20.494990 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1321/2602] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:05:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:05:20.815007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:20.816624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:20.836051 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7256851-de2a-4ef8-ae6a-f94fb56f6bc9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:20.841900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:20.842903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:20.843262 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:20.843612 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] PATH_INFO: `/v3/users/ac89928ac188406d910838be33a61c3e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:20.860456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac89928ac188406d910838be33a61c3e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:20.862753 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:20.916650 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac89928ac188406d910838be33a61c3e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:20.923219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac89928ac188406d910838be33a61c3e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:20.923926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac89928ac188406d910838be33a61c3e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:20.935616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac89928ac188406d910838be33a61c3e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:20.936427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c7b7ee83-cb79-4bf3-ad23-24d7c0afbf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac89928ac188406d910838be33a61c3e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:20.950314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1282/2603] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:20 2022] DELETE /identity/v3/users/ac89928ac188406d910838be33a61c3e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:21.135016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.148659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a702b4-1821-4af5-b675-0cfe3c541506 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.207644 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.208556 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.208843 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.209116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] PATH_INFO: `/v3/projects/9d31191dfc694e3b94a6139dd2e9653f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.220474 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d31191dfc694e3b94a6139dd2e9653f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:21.222434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:21.268403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d31191dfc694e3b94a6139dd2e9653f', 'request_id': 'req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:21.275208 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d31191dfc694e3b94a6139dd2e9653f', 'request_id': 'req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:21.284099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d31191dfc694e3b94a6139dd2e9653f', 'request_id': 'req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:21.295118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] The token cache is being invalidate because project 9d31191dfc694e3b94a6139dd2e9653f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:21.295405 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:21.296182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc0af83b-c66a-4f1a-b4c8-73a8781a8558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:21.297909 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1322/2604] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:21 2022] DELETE /identity/v3/projects/9d31191dfc694e3b94a6139dd2e9653f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:21.303068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40229b2b-37fc-4749-b7ff-d3291619a7f0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.303366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40229b2b-37fc-4749-b7ff-d3291619a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.303648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40229b2b-37fc-4749-b7ff-d3291619a7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.322547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-40229b2b-37fc-4749-b7ff-d3291619a7f0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:21.323760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-40229b2b-37fc-4749-b7ff-d3291619a7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:21.401241 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1283/2605] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:21.402723 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab3b38-9ef0-4f35-ba3e-ed7be11a82bc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.403023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab3b38-9ef0-4f35-ba3e-ed7be11a82bc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.403387 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab3b38-9ef0-4f35-ba3e-ed7be11a82bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.421918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-efab3b38-9ef0-4f35-ba3e-ed7be11a82bc None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:21.423202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-efab3b38-9ef0-4f35-ba3e-ed7be11a82bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:21.432158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1323/2606] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:21.437310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40229b2b-37fc-4749-b7ff-d3291619a7f0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.447444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40229b2b-37fc-4749-b7ff-d3291619a7f0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.452167 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.452835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.453119 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.453394 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.454245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:21.454709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:21.456369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:21.468607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1284/2607] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:21.473786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab3b38-9ef0-4f35-ba3e-ed7be11a82bc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.483225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab3b38-9ef0-4f35-ba3e-ed7be11a82bc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.488340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.489062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.489290 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.489566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.490270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:21.492239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:21.520995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1324/2608] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:21 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:21.525040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.535697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c47f1-fc10-4760-8538-ca198ae3b021 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.600391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.601067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.601454 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.601734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.602413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:21.604366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:21.625369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1285/2609] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:21 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:21.629718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.640068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37723b0a-342d-44c9-887d-65cba5518ab2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.644761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.645423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.645704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.645977 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.646692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:21.648349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:21.658486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1325/2610] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:21.663351 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.676265 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da721410-221b-4139-8859-826fb23d8f25 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.682250 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf438d5-b391-45ad-b375-4fce4c879c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.682917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf438d5-b391-45ad-b375-4fce4c879c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.683201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf438d5-b391-45ad-b375-4fce4c879c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.683480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf438d5-b391-45ad-b375-4fce4c879c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.684257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf438d5-b391-45ad-b375-4fce4c879c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:21.685904 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf438d5-b391-45ad-b375-4fce4c879c10 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:21.695913 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1286/2611] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:21.700352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.710456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c449-bd8c-4d8a-a340-a41cdf574a61 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.715837 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.716764 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.717047 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.717322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] PATH_INFO: `/v3/projects/02db8a3f6ac0450e985f728f78c72c11/users/f6f1bd9ffa134c65a3417fd74a754e25/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.740714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02db8a3f6ac0450e985f728f78c72c11, user_id=f6f1bd9ffa134c65a3417fd74a754e25, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:21.744539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:21.765096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1326/2612] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:21 2022] PUT /identity/v3/projects/02db8a3f6ac0450e985f728f78c72c11/users/f6f1bd9ffa134c65a3417fd74a754e25/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:21.780882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.781228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.781562 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:21.809010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] MFA Rules not processed for user `f6f1bd9ffa134c65a3417fd74a754e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:21.810218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:21.883618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1287/2613] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:21.899256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:21.902042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:21.987640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c0e0-2352-4dc3-b187-4aadb7485b72 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:21.993716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f9e84-7423-4b16-87a9-acbd962c5060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:21.994294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f9e84-7423-4b16-87a9-acbd962c5060 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:21.994575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f9e84-7423-4b16-87a9-acbd962c5060 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:21.994842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f9e84-7423-4b16-87a9-acbd962c5060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:22.002817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f9e84-7423-4b16-87a9-acbd962c5060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:22.005043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f9e84-7423-4b16-87a9-acbd962c5060 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:22.013770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1327/2614] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:30.013972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:30.016269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:30.084558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d006d4-70ee-44d1-9ed8-78cdfbcc5953 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:30.090063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:30.090955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.091243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.091524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] PATH_INFO: `/v3/users/8a3e1aa1fc2640849e8315f84c98b625` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.092762 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3e1aa1fc2640849e8315f84c98b625)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:30.094717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:30.144582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3e1aa1fc2640849e8315f84c98b625'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.152239 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3e1aa1fc2640849e8315f84c98b625'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.152935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3e1aa1fc2640849e8315f84c98b625'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.165085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3e1aa1fc2640849e8315f84c98b625'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.165757 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3e1aa1fc2640849e8315f84c98b625'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.180961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1288/2615] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:30 2022] DELETE /identity/v3/users/8a3e1aa1fc2640849e8315f84c98b625 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:30.186537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.187040 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.187154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.205478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:30.206735 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:30.268686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1328/2616] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:30.279360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:30.281156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:30.354485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc183e-d44b-4cbc-a70a-fefb7a620a48 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:30.358346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579206e9-5f17-465e-bb5e-292b4f085ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:30.359003 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579206e9-5f17-465e-bb5e-292b4f085ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.359284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579206e9-5f17-465e-bb5e-292b4f085ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.359560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579206e9-5f17-465e-bb5e-292b4f085ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.369905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579206e9-5f17-465e-bb5e-292b4f085ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:30.371574 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579206e9-5f17-465e-bb5e-292b4f085ce7 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:30.382851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1289/2617] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:30.564656 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:30.566168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:30.578694 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81e9ff-25a2-43e1-ac2d-1ad8b1f7353e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:30.584139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:30.585029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.585312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.585587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] PATH_INFO: `/v3/projects/d2bc498dbd674965a795f4ea1e1ba246` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.586958 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bc498dbd674965a795f4ea1e1ba246)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:30.589561 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:30.640729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bc498dbd674965a795f4ea1e1ba246', 'request_id': 'req-04366ea5-6b25-4129-9610-1f586ae3e3b0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.649298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bc498dbd674965a795f4ea1e1ba246', 'request_id': 'req-04366ea5-6b25-4129-9610-1f586ae3e3b0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.659997 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bc498dbd674965a795f4ea1e1ba246', 'request_id': 'req-04366ea5-6b25-4129-9610-1f586ae3e3b0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.670941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] The token cache is being invalidate because project d2bc498dbd674965a795f4ea1e1ba246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:30.671258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.671956 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-04366ea5-6b25-4129-9610-1f586ae3e3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:30.673583 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1329/2618] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:30 2022] DELETE /identity/v3/projects/d2bc498dbd674965a795f4ea1e1ba246 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:30.679329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33c10-0275-40b5-8247-32f653add6fe None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.679625 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33c10-0275-40b5-8247-32f653add6fe None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.679903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33c10-0275-40b5-8247-32f653add6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.699049 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6de33c10-0275-40b5-8247-32f653add6fe None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:30.700299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6de33c10-0275-40b5-8247-32f653add6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:30.763078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1290/2619] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:30.774229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404f7e-33fd-4e95-8dc6-3f68df0223d3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.774724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404f7e-33fd-4e95-8dc6-3f68df0223d3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.775079 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404f7e-33fd-4e95-8dc6-3f68df0223d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.797668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0f404f7e-33fd-4e95-8dc6-3f68df0223d3 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:30.798888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0f404f7e-33fd-4e95-8dc6-3f68df0223d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:30.808897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1330/2620] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:30.815282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de33c10-0275-40b5-8247-32f653add6fe None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:30.830788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de33c10-0275-40b5-8247-32f653add6fe None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:30.837046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:30.837749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.838030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.838300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.839104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:30.839310 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:30.840965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:30.857165 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1291/2621] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:30.858566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404f7e-33fd-4e95-8dc6-3f68df0223d3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:30.867806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404f7e-33fd-4e95-8dc6-3f68df0223d3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:30.873524 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:30.874260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.874548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.874823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.875513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:30.877767 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:30.908799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1331/2622] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:30 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:30.909993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:30.919917 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de384a7-6f7a-4308-aadb-112f78d70a09 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:30.981740 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:30.982456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:30.982739 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:30.983017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:30.983717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:30.985802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.012038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1292/2623] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:30 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:31.013258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.025714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2ab27-20f5-4a56-9c58-c80325a48f60 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.031177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.031863 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.032176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.032456 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.033408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.035031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.046045 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1332/2624] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:31.051014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.062661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd1c17-37c9-4dec-8efc-2fed4f9fb7b2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.068198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.068871 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.069156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.069451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.070170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.071894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.084774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1293/2625] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:31.089073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.100465 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d963d-b75c-46d3-8589-440beab1ecb4 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.106506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f30cca-9031-49cd-a242-f88105c92ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.107550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f30cca-9031-49cd-a242-f88105c92ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.107899 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f30cca-9031-49cd-a242-f88105c92ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.108241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f30cca-9031-49cd-a242-f88105c92ae8 admin admin] PATH_INFO: `/v3/projects/1c23384b87b5400ea4b4e19aa265d33d/users/cd4bbc59894445d4b5e46ab6cabb1c97/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.132818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f30cca-9031-49cd-a242-f88105c92ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c23384b87b5400ea4b4e19aa265d33d, user_id=cd4bbc59894445d4b5e46ab6cabb1c97, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.146677 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f30cca-9031-49cd-a242-f88105c92ae8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.165242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.165242 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.178640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e3bb-c0e2-4967-8c6b-0ebf025727d3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.191842 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1333/2626] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:31 2022] PUT /identity/v3/projects/1c23384b87b5400ea4b4e19aa265d33d/users/cd4bbc59894445d4b5e46ab6cabb1c97/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:31.195188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.195537 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.196259 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.238076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] MFA Rules not processed for user `cd4bbc59894445d4b5e46ab6cabb1c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:31.239594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.251243 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.252321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.252819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.253176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] PATH_INFO: `/v3/users/f6f1bd9ffa134c65a3417fd74a754e25` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.254867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f1bd9ffa134c65a3417fd74a754e25)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.257116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.307346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f1bd9ffa134c65a3417fd74a754e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.307953 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1334/2627] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:31.314150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f1bd9ffa134c65a3417fd74a754e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.315050 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f1bd9ffa134c65a3417fd74a754e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.319696 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.321088 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.326484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f1bd9ffa134c65a3417fd74a754e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.327174 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8b298bd5-86f2-48a7-ad7a-153047fa00ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f1bd9ffa134c65a3417fd74a754e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.341150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1294/2628] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:31 2022] DELETE /identity/v3/users/f6f1bd9ffa134c65a3417fd74a754e25 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:31.346129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.346129 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.346427 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.363561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:31.364794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.378618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a7e9-4ca5-4f80-9645-142554bfbdc4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.423608 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1295/2629] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:31.426217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.426888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.427173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.427448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.429672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.434021 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.435323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.490555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.492058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.492455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3fe46-13ad-4452-bb39-e169f3039691 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.496172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448692a4-44c4-4439-b776-806bce783ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.496801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448692a4-44c4-4439-b776-806bce783ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.497093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448692a4-44c4-4439-b776-806bce783ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.497372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448692a4-44c4-4439-b776-806bce783ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.501025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1335/2630] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:31.509758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448692a4-44c4-4439-b776-806bce783ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.511344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448692a4-44c4-4439-b776-806bce783ad0 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.522068 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1296/2631] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:31.806618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.809765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.824691 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8e9c9-1666-409c-ab2e-3c33a53b94a1 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.829475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.831143 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.831544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.831709 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] PATH_INFO: `/v3/projects/02db8a3f6ac0450e985f728f78c72c11` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.833085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02db8a3f6ac0450e985f728f78c72c11)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.835009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.883981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02db8a3f6ac0450e985f728f78c72c11', 'request_id': 'req-fb42a5dd-743a-443c-8dbc-26f16eff15d0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.890039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02db8a3f6ac0450e985f728f78c72c11', 'request_id': 'req-fb42a5dd-743a-443c-8dbc-26f16eff15d0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.897878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02db8a3f6ac0450e985f728f78c72c11', 'request_id': 'req-fb42a5dd-743a-443c-8dbc-26f16eff15d0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.909127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] The token cache is being invalidate because project 02db8a3f6ac0450e985f728f78c72c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:31.909504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.910183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-fb42a5dd-743a-443c-8dbc-26f16eff15d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:31.912097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1336/2632] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:31 2022] DELETE /identity/v3/projects/02db8a3f6ac0450e985f728f78c72c11 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:31.917233 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b0e29-ac4e-4d0e-bde3-4f002c6bb89e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.917510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b0e29-ac4e-4d0e-bde3-4f002c6bb89e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.917786 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b0e29-ac4e-4d0e-bde3-4f002c6bb89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.936261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-606b0e29-ac4e-4d0e-bde3-4f002c6bb89e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:31.937399 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-606b0e29-ac4e-4d0e-bde3-4f002c6bb89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.007689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1297/2633] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.016142 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353df1-3048-4b78-8c05-e8fe145d39c8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.016444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353df1-3048-4b78-8c05-e8fe145d39c8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.016747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353df1-3048-4b78-8c05-e8fe145d39c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.036687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ba353df1-3048-4b78-8c05-e8fe145d39c8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.037929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ba353df1-3048-4b78-8c05-e8fe145d39c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.046584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1337/2634] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:32.050954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b0e29-ac4e-4d0e-bde3-4f002c6bb89e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.061622 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b0e29-ac4e-4d0e-bde3-4f002c6bb89e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.067447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.068162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.068448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.069033 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.069785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:32.070097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.071730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.084803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1298/2635] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:32.089681 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353df1-3048-4b78-8c05-e8fe145d39c8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.099794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353df1-3048-4b78-8c05-e8fe145d39c8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.105196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.105858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.106144 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.106422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.107126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.109080 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.136375 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1338/2636] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:32.140688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.150868 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532d844-34d6-41d7-88a2-73355fea18b9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.213338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.214301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.214684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.214963 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.216044 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.219004 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.243072 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1299/2637] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:32.247240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.257748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c29a4-3dfd-4905-85fe-ad1c0ea32fb6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.263041 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.263784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.264171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.264500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.265237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.266839 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.277829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1339/2638] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.282172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.292999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522618-2197-4fc7-8cde-147614030bef admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.298466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303f0a5-695f-4a3a-9e86-72c46ace66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.299194 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f0a5-695f-4a3a-9e86-72c46ace66e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.299481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f0a5-695f-4a3a-9e86-72c46ace66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.299773 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f0a5-695f-4a3a-9e86-72c46ace66e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.300652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303f0a5-695f-4a3a-9e86-72c46ace66e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.302263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303f0a5-695f-4a3a-9e86-72c46ace66e7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.312996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1300/2639] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.317395 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.327498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdf403-8936-4972-9a29-d5e95692fb81 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.332332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.333225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.333545 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.333822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] PATH_INFO: `/v3/projects/abc1d4d6faf04e16922a2d3f662b74f6/users/92075eb9aaff409e935d168e8a74b0e2/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.349152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc1d4d6faf04e16922a2d3f662b74f6, user_id=92075eb9aaff409e935d168e8a74b0e2, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.351801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.369916 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1340/2640] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:32 2022] PUT /identity/v3/projects/abc1d4d6faf04e16922a2d3f662b74f6/users/92075eb9aaff409e935d168e8a74b0e2/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:32.381424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a645bde-e49d-4850-8380-89e02124edfc None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.381704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a645bde-e49d-4850-8380-89e02124edfc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.382007 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a645bde-e49d-4850-8380-89e02124edfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.408643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8a645bde-e49d-4850-8380-89e02124edfc None None] MFA Rules not processed for user `92075eb9aaff409e935d168e8a74b0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.409875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8a645bde-e49d-4850-8380-89e02124edfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.477297 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1301/2641] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.481846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.552448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64d34e-a36a-48e6-b610-620b172de5e9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.558016 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.558487 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.558858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.559191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.559989 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.562218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.592438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1341/2642] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:32.596458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a645bde-e49d-4850-8380-89e02124edfc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.607671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a645bde-e49d-4850-8380-89e02124edfc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.667137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.667834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.668147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.668421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.669104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.671053 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.692245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1302/2643] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:32.696505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.706917 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1c6a6-5ea1-4457-8046-71a9065c5eb9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.711919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.712566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.712852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.713136 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.713876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.715488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.726596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1342/2644] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.730952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.741658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d74af-d1e0-4ea0-a90f-09197e581a9b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.747597 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.748470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.748752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.748995 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] PATH_INFO: `/v3/projects/eb90dfbda6474ddcb8a9dff3f74dbcb9/users/d4df07449bd84e37a6c2fb70d5b5593c/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.765328 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb90dfbda6474ddcb8a9dff3f74dbcb9, user_id=d4df07449bd84e37a6c2fb70d5b5593c, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.768092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.784391 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1303/2645] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:32 2022] PUT /identity/v3/projects/eb90dfbda6474ddcb8a9dff3f74dbcb9/users/d4df07449bd84e37a6c2fb70d5b5593c/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:32.789274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.803352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ee9c-ce43-44cf-9b64-49f56efc8763 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.867323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cbcb9-3ea2-4075-8e24-fb06b0f503b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.868036 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbcb9-3ea2-4075-8e24-fb06b0f503b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.868302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbcb9-3ea2-4075-8e24-fb06b0f503b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.868573 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbcb9-3ea2-4075-8e24-fb06b0f503b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.869303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cbcb9-3ea2-4075-8e24-fb06b0f503b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.870993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cbcb9-3ea2-4075-8e24-fb06b0f503b4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.882313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1343/2646] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.886517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.897495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149c788-1306-4c35-8d93-e373ca08feed admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.902766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.903661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.903970 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.904248 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] PATH_INFO: `/v3/projects/eb90dfbda6474ddcb8a9dff3f74dbcb9/users/d4df07449bd84e37a6c2fb70d5b5593c/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.906315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb90dfbda6474ddcb8a9dff3f74dbcb9, user_id=d4df07449bd84e37a6c2fb70d5b5593c, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.909094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.920401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1304/2647] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:32 2022] PUT /identity/v3/projects/eb90dfbda6474ddcb8a9dff3f74dbcb9/users/d4df07449bd84e37a6c2fb70d5b5593c/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:32.931035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e099703-f125-4e4d-afb3-ce5812fcf86b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.931363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e099703-f125-4e4d-afb3-ce5812fcf86b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.931646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e099703-f125-4e4d-afb3-ce5812fcf86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.960263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3e099703-f125-4e4d-afb3-ce5812fcf86b None None] MFA Rules not processed for user `d4df07449bd84e37a6c2fb70d5b5593c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.961611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3e099703-f125-4e4d-afb3-ce5812fcf86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:33.038149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1344/2648] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:33.049699 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.051760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:33.110203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c26a6a-3e02-4619-b4c9-7ffd5eb317b0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.114535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704a22b-ac1a-40cd-8340-5c97cec4a851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.115183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704a22b-ac1a-40cd-8340-5c97cec4a851 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.115469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704a22b-ac1a-40cd-8340-5c97cec4a851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.115741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704a22b-ac1a-40cd-8340-5c97cec4a851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.125218 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704a22b-ac1a-40cd-8340-5c97cec4a851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.126682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704a22b-ac1a-40cd-8340-5c97cec4a851 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.136662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1305/2649] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:36.475781 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e099703-f125-4e4d-afb3-ce5812fcf86b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.545322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e099703-f125-4e4d-afb3-ce5812fcf86b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.550300 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.551246 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.551523 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.551794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] PATH_INFO: `/v3/users/92075eb9aaff409e935d168e8a74b0e2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.553029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92075eb9aaff409e935d168e8a74b0e2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.554938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.605762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92075eb9aaff409e935d168e8a74b0e2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:36.614299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92075eb9aaff409e935d168e8a74b0e2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:36.626082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92075eb9aaff409e935d168e8a74b0e2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:36.633410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92075eb9aaff409e935d168e8a74b0e2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:36.634073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92075eb9aaff409e935d168e8a74b0e2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:36.641258 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1345/2650] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:36 2022] DELETE /identity/v3/users/92075eb9aaff409e935d168e8a74b0e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:36.647329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.647822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.647942 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.668939 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:36.670187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:36.730009 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1306/2651] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:36.743113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.745603 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:36.807999 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38041ad-261f-44e6-96e3-5824b952ba54 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.812075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.812725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.813008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.813282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.823051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.824541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.834257 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1346/2652] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:37.114535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:37.116124 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:37.130758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f771c-d2c0-42d6-ab5a-8406d09c8ea8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:37.140264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:37.141166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.141561 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.141719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] PATH_INFO: `/v3/projects/abc1d4d6faf04e16922a2d3f662b74f6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.143114 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc1d4d6faf04e16922a2d3f662b74f6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:37.145202 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:37.196161 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc1d4d6faf04e16922a2d3f662b74f6', 'request_id': 'req-58742ca3-1243-46e8-8829-719d40b87110'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.202448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc1d4d6faf04e16922a2d3f662b74f6', 'request_id': 'req-58742ca3-1243-46e8-8829-719d40b87110'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.211644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc1d4d6faf04e16922a2d3f662b74f6', 'request_id': 'req-58742ca3-1243-46e8-8829-719d40b87110'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.222036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] The token cache is being invalidate because project abc1d4d6faf04e16922a2d3f662b74f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:37.222364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.223449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.225137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1307/2653] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:37 2022] DELETE /identity/v3/projects/abc1d4d6faf04e16922a2d3f662b74f6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:37.229232 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:37.239829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4b6b2-f951-466d-9b01-b8c01baa6eb4 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:37.297333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:37.298214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.298500 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.298769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] PATH_INFO: `/v3/users/d4df07449bd84e37a6c2fb70d5b5593c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.300048 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4df07449bd84e37a6c2fb70d5b5593c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:37.302167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:37.354117 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4df07449bd84e37a6c2fb70d5b5593c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.362017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4df07449bd84e37a6c2fb70d5b5593c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.374306 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4df07449bd84e37a6c2fb70d5b5593c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.381521 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4df07449bd84e37a6c2fb70d5b5593c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.382185 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-0a8120aa-f308-45e2-b709-991df193244c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4df07449bd84e37a6c2fb70d5b5593c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.388165 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1347/2654] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:37 2022] DELETE /identity/v3/users/d4df07449bd84e37a6c2fb70d5b5593c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:37.679246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:37.680851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:37.696449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58742ca3-1243-46e8-8829-719d40b87110 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:37.757348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:37.758130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.758400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.758689 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] PATH_INFO: `/v3/projects/eb90dfbda6474ddcb8a9dff3f74dbcb9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.760106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb90dfbda6474ddcb8a9dff3f74dbcb9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:37.762034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:37.820412 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb90dfbda6474ddcb8a9dff3f74dbcb9', 'request_id': 'req-aeaab61d-455b-457f-8a71-c5e70a0046b6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.826776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb90dfbda6474ddcb8a9dff3f74dbcb9', 'request_id': 'req-aeaab61d-455b-457f-8a71-c5e70a0046b6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.836370 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb90dfbda6474ddcb8a9dff3f74dbcb9', 'request_id': 'req-aeaab61d-455b-457f-8a71-c5e70a0046b6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.846729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] The token cache is being invalidate because project eb90dfbda6474ddcb8a9dff3f74dbcb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:37.847015 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.848270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aeaab61d-455b-457f-8a71-c5e70a0046b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:37.850014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1308/2655] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:37 2022] DELETE /identity/v3/projects/eb90dfbda6474ddcb8a9dff3f74dbcb9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:37.855171 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e35f5-e867-4714-a6b3-d6b8b244ddaa None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.855675 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e35f5-e867-4714-a6b3-d6b8b244ddaa None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.855792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e35f5-e867-4714-a6b3-d6b8b244ddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.876628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-577e35f5-e867-4714-a6b3-d6b8b244ddaa None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:37.877832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-577e35f5-e867-4714-a6b3-d6b8b244ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:37.939502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1348/2656] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:37.951387 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf29dc0-aaf6-410c-84d8-9150fa16e617 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.951656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf29dc0-aaf6-410c-84d8-9150fa16e617 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.951996 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf29dc0-aaf6-410c-84d8-9150fa16e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.972841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4bf29dc0-aaf6-410c-84d8-9150fa16e617 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:37.973947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4bf29dc0-aaf6-410c-84d8-9150fa16e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:37.983481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1309/2657] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:37.988569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e35f5-e867-4714-a6b3-d6b8b244ddaa None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:37.998116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e35f5-e867-4714-a6b3-d6b8b244ddaa None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.003116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.004043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.004357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.004641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.005373 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:38.005682 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.007327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.021271 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1349/2658] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:38.025935 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf29dc0-aaf6-410c-84d8-9150fa16e617 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.035894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf29dc0-aaf6-410c-84d8-9150fa16e617 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.041158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.041807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.042090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.042379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.043067 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.045035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.073184 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1310/2659] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:38.077384 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.087317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6198d-7be3-487d-a051-1001ec955773 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.147380 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.148081 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.148444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.148715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.149404 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.151353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.174752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1350/2660] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:38.179385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.190559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4314aef-f03d-4126-9ae6-69f9ea46c986 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.197100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.197776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.198061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.198336 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.199078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.200737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.211997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1311/2661] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:38.216188 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.227382 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c64c6-9169-4b9b-a813-2afb5479f815 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.233274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21eaf-f101-4cb7-b5ed-a625c2bc1c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.233935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21eaf-f101-4cb7-b5ed-a625c2bc1c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.234205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21eaf-f101-4cb7-b5ed-a625c2bc1c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.234567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21eaf-f101-4cb7-b5ed-a625c2bc1c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.235308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21eaf-f101-4cb7-b5ed-a625c2bc1c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.236955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21eaf-f101-4cb7-b5ed-a625c2bc1c01 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.248275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1351/2662] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:05:38.252764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.263601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd50a7-d3f7-4bd0-858b-475bd939c1d3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.269286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.270173 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.270458 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.270738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] PATH_INFO: `/v3/projects/27ae0587040c496e937602c753358824/users/cd106249da5f4b278ad88f7b920b3929/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.286093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ae0587040c496e937602c753358824, user_id=cd106249da5f4b278ad88f7b920b3929, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.288719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.304634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1312/2663] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:38 2022] PUT /identity/v3/projects/27ae0587040c496e937602c753358824/users/cd106249da5f4b278ad88f7b920b3929/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:38.316622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3beb9-d59a-4bda-b0d3-b067c27776e7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.316905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3beb9-d59a-4bda-b0d3-b067c27776e7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.317182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3beb9-d59a-4bda-b0d3-b067c27776e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.346713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-85c3beb9-d59a-4bda-b0d3-b067c27776e7 None None] MFA Rules not processed for user `cd106249da5f4b278ad88f7b920b3929`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:38.348578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-85c3beb9-d59a-4bda-b0d3-b067c27776e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:38.414245 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1352/2664] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:38.420840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.484645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928488-8798-4d6c-bd56-c1f63489bf36 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.490566 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.491236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.491517 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.491790 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.492525 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.494464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.523635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1313/2665] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:38.527845 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3beb9-d59a-4bda-b0d3-b067c27776e7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.539247 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3beb9-d59a-4bda-b0d3-b067c27776e7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.594393 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.595070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.595357 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.595625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.596359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.598635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.622786 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1353/2666] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:38.627085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.638027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d711b-555a-424e-a51e-be1a81dceb07 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.644125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.644867 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.645150 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.645426 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.646177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.647782 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.658321 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1314/2667] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:38.662475 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.672605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca961c-6ae3-4599-b166-db3b12b6077a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.677431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dad04-d597-4c85-9ee4-b9c50f9dad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.678090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dad04-d597-4c85-9ee4-b9c50f9dad45 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.678376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dad04-d597-4c85-9ee4-b9c50f9dad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.678648 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dad04-d597-4c85-9ee4-b9c50f9dad45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.679378 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dad04-d597-4c85-9ee4-b9c50f9dad45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.681012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dad04-d597-4c85-9ee4-b9c50f9dad45 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.690762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1354/2668] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:38.694931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.705253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29b92f-e234-4200-a660-e0fd458dfe0a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.710345 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.711261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.711538 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.711812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] PATH_INFO: `/v3/projects/0cc6aedc57bb446ca161110c5c6c693c/users/59e1d691bf97464fbca7752a6dbb91d2/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.727106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc6aedc57bb446ca161110c5c6c693c, user_id=59e1d691bf97464fbca7752a6dbb91d2, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.729820 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.744811 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1315/2669] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:38 2022] PUT /identity/v3/projects/0cc6aedc57bb446ca161110c5c6c693c/users/59e1d691bf97464fbca7752a6dbb91d2/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:38.759795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892a72e-128e-4d59-bfcc-b19ed1ab3acc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.760124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892a72e-128e-4d59-bfcc-b19ed1ab3acc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.760408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892a72e-128e-4d59-bfcc-b19ed1ab3acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.786704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b892a72e-128e-4d59-bfcc-b19ed1ab3acc None None] MFA Rules not processed for user `59e1d691bf97464fbca7752a6dbb91d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:38.787919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b892a72e-128e-4d59-bfcc-b19ed1ab3acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:38.848730 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1355/2670] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:38.855452 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.925520 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362750d-aeb2-46b8-9d64-ac3740fc9011 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.930463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.931125 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.931404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.931676 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.932418 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.934312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.963623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1316/2671] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:38.967962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892a72e-128e-4d59-bfcc-b19ed1ab3acc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.979547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892a72e-128e-4d59-bfcc-b19ed1ab3acc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:39.034670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:39.035366 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.035646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.035914 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.036636 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:39.038532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:39.060388 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1356/2672] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:38 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:39.064749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:39.075445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3230-ade2-4b01-bd95-653a627b73fb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:39.080163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:39.080823 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.081141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.081420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.082350 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:39.083987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:39.094395 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1317/2673] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:39.099929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:39.114881 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271969f-8c50-4099-b25f-b7627c723119 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:39.123807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:39.125101 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.125428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.125716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] PATH_INFO: `/v3/projects/48756f06f870410485e67145fc358495/users/79b0cd23948946f799c28d08eb071987/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.142822 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48756f06f870410485e67145fc358495, user_id=79b0cd23948946f799c28d08eb071987, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:39.145555 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:39.162897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1357/2674] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:39 2022] PUT /identity/v3/projects/48756f06f870410485e67145fc358495/users/79b0cd23948946f799c28d08eb071987/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:39.167074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:39.178355 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8133b7d-a7de-4aba-9cf5-9c2e4aa5d924 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:39.236406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b1dd-fec1-40f4-a7c2-2db20394eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:39.237079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b1dd-fec1-40f4-a7c2-2db20394eccf admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.237364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b1dd-fec1-40f4-a7c2-2db20394eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.237640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b1dd-fec1-40f4-a7c2-2db20394eccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.238407 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481b1dd-fec1-40f4-a7c2-2db20394eccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:39.240055 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481b1dd-fec1-40f4-a7c2-2db20394eccf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:39.249634 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1318/2675] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:39.255532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:39.266558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a754d7-15a6-452c-bfd5-9e4c387a622a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:39.272286 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:39.273158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.273438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.273710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] PATH_INFO: `/v3/projects/48756f06f870410485e67145fc358495/users/79b0cd23948946f799c28d08eb071987/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.275775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48756f06f870410485e67145fc358495, user_id=79b0cd23948946f799c28d08eb071987, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:39.278422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:39.288937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1358/2676] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:39 2022] PUT /identity/v3/projects/48756f06f870410485e67145fc358495/users/79b0cd23948946f799c28d08eb071987/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:39.300467 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8ea3f-5ba5-4529-b283-b81b00b6c8da None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.300766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8ea3f-5ba5-4529-b283-b81b00b6c8da None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.301040 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8ea3f-5ba5-4529-b283-b81b00b6c8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.327136 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-eee8ea3f-5ba5-4529-b283-b81b00b6c8da None None] MFA Rules not processed for user `79b0cd23948946f799c28d08eb071987`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:39.328363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eee8ea3f-5ba5-4529-b283-b81b00b6c8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:39.408414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1319/2677] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:39.419340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:39.421821 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:39.491304 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771805-e98b-4083-8f3f-946866c800d5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:39.495674 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:39.496359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.496647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.496928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.509627 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:39.511110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:39.522354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1359/2678] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:40.058486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8ea3f-5ba5-4529-b283-b81b00b6c8da None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:40.069289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8ea3f-5ba5-4529-b283-b81b00b6c8da None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:40.073784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:40.074410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:40.074732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:40.074998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:40.137456 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:40.138925 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:40.148469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1320/2679] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:53.695986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:53.705213 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7581-e5b6-4a26-b89c-315c70f28fda service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:53.709613 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7cbe2-e052-441e-bed0-be388ed8bc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:53.710272 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7cbe2-e052-441e-bed0-be388ed8bc93 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:53.710552 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7cbe2-e052-441e-bed0-be388ed8bc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:53.710860 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7cbe2-e052-441e-bed0-be388ed8bc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:53.776340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7cbe2-e052-441e-bed0-be388ed8bc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:53.777794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7cbe2-e052-441e-bed0-be388ed8bc93 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:53.787163 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1360/2680] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:55.117849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:55.119498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:55.189191 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d64da-4614-4b08-b9e0-35a96a39fc70 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:55.194290 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:55.195172 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.195476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.195735 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] PATH_INFO: `/v3/users/ce07e0e94d0044768d549486b06712ca` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.197020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce07e0e94d0044768d549486b06712ca)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:55.198977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:55.257661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce07e0e94d0044768d549486b06712ca'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.264797 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce07e0e94d0044768d549486b06712ca'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.265483 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce07e0e94d0044768d549486b06712ca'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.277662 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce07e0e94d0044768d549486b06712ca'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.278313 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce07e0e94d0044768d549486b06712ca'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.293708 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1321/2681] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:55 2022] DELETE /identity/v3/users/ce07e0e94d0044768d549486b06712ca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:55.298435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.298985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.298985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.316409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:55.317606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:55.388367 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1361/2682] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:55.400059 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:55.401760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:55.463282 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3f12-05a2-4b24-b67c-763ee8266d44 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:55.467524 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08bc22-4432-48d3-8d1e-bd287f28ce7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:55.468203 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08bc22-4432-48d3-8d1e-bd287f28ce7a service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.468480 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08bc22-4432-48d3-8d1e-bd287f28ce7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.468750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08bc22-4432-48d3-8d1e-bd287f28ce7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.488730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08bc22-4432-48d3-8d1e-bd287f28ce7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:55.490224 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08bc22-4432-48d3-8d1e-bd287f28ce7a service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:55.502865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1322/2683] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:55.810973 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:55.812589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:55.830287 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080212-d7da-4f90-97d2-5ddb8e97f7dc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:55.845966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:55.847424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.847716 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.848082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] PATH_INFO: `/v3/projects/4484818168ed4b709bc79a714ab95ba5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.849485 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4484818168ed4b709bc79a714ab95ba5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:55.851544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:55.904007 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4484818168ed4b709bc79a714ab95ba5', 'request_id': 'req-c6c2c54c-1684-4c30-8ccd-70c81312bb68'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.910221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4484818168ed4b709bc79a714ab95ba5', 'request_id': 'req-c6c2c54c-1684-4c30-8ccd-70c81312bb68'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.919658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4484818168ed4b709bc79a714ab95ba5', 'request_id': 'req-c6c2c54c-1684-4c30-8ccd-70c81312bb68'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.930360 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] The token cache is being invalidate because project 4484818168ed4b709bc79a714ab95ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:55.930647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.931268 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:55.932865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1362/2684] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:55 2022] DELETE /identity/v3/projects/4484818168ed4b709bc79a714ab95ba5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:55.937992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2473cc3-c12d-4766-b15c-a202690abe9b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.938277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2473cc3-c12d-4766-b15c-a202690abe9b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.938556 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2473cc3-c12d-4766-b15c-a202690abe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.956444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f2473cc3-c12d-4766-b15c-a202690abe9b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:55.957641 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f2473cc3-c12d-4766-b15c-a202690abe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:55.967727 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:55.969192 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.022809 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1323/2685] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:56.031565 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d68e2-87e9-4fc2-9b60-5ed980e6443b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.031861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d68e2-87e9-4fc2-9b60-5ed980e6443b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.032373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d68e2-87e9-4fc2-9b60-5ed980e6443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.034176 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2c54c-1684-4c30-8ccd-70c81312bb68 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.038939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.039828 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.040147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.040426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] PATH_INFO: `/v3/users/cd106249da5f4b278ad88f7b920b3929` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.041624 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd106249da5f4b278ad88f7b920b3929)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.043773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.050947 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d84d68e2-87e9-4fc2-9b60-5ed980e6443b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:56.052188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d84d68e2-87e9-4fc2-9b60-5ed980e6443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.061838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1324/2686] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:56.064857 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d68e2-87e9-4fc2-9b60-5ed980e6443b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.074476 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d68e2-87e9-4fc2-9b60-5ed980e6443b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.079785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.080540 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.080851 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.081155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.081908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:56.082237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.083889 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.095841 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1325/2687] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:05:56.097904 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd106249da5f4b278ad88f7b920b3929'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.100672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.107406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd106249da5f4b278ad88f7b920b3929'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.112232 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcaa38-85b0-4800-a296-ed13891c2a6c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.117505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.118190 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.118793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.118793 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.119397 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.120170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd106249da5f4b278ad88f7b920b3929'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.121972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.127241 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd106249da5f4b278ad88f7b920b3929'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.127961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-acf57e6a-c1ac-4433-9509-dc5ffd5ab18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd106249da5f4b278ad88f7b920b3929'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.133799 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1363/2688] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:55 2022] DELETE /identity/v3/users/cd106249da5f4b278ad88f7b920b3929 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:56.138855 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.139221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.139690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.150912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1326/2689] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:56 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:56.154961 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.156584 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.157910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:56.159269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.220385 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1364/2690] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:56.221657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435adada-ed90-42bf-a72b-bf42a3ca92c8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.226907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.227587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.227892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.228176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.228872 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.230884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.231081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.232248 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.260146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1327/2691] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:56 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:56.261616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.272027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753ef9c-6f93-4092-b8cd-e21008ee9f55 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.278208 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.278808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.279095 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.279375 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.280141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.281758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.291014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314aefb-6f2e-4031-8b66-43d4c0b55c7b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.295164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1328/2692] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:56.296061 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.296263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.296801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.297086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.297363 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.306315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0e34-b3df-4129-80cc-98b2e3043478 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.306725 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.308194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.311544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79499589-61b3-4585-874a-02c7ba3f8a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.312234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499589-61b3-4585-874a-02c7ba3f8a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.312512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499589-61b3-4585-874a-02c7ba3f8a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.312779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499589-61b3-4585-874a-02c7ba3f8a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.313495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499589-61b3-4585-874a-02c7ba3f8a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.315146 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499589-61b3-4585-874a-02c7ba3f8a59 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.317927 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1365/2693] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:56.325892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1329/2694] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:56.330150 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.340147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0604a0-e30e-4713-9c1b-d5f58925f7f7 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.346137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.347495 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.347954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.348237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] PATH_INFO: `/v3/projects/5b2f77cfe7474b91b9ac142235c0986b/users/c16bc2d6c6b243988cef4ef44e9f019b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.364343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2f77cfe7474b91b9ac142235c0986b, user_id=c16bc2d6c6b243988cef4ef44e9f019b, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.367127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.380841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1366/2695] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:56 2022] PUT /identity/v3/projects/5b2f77cfe7474b91b9ac142235c0986b/users/c16bc2d6c6b243988cef4ef44e9f019b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:56.392348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.392642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.392932 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.421819 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] MFA Rules not processed for user `c16bc2d6c6b243988cef4ef44e9f019b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:56.422957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.488618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1330/2696] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:56.501814 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.503710 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.565960 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b30b2-f1a0-4486-924d-596ac68870e9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.569634 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.570289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.570575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.570857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.581392 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.582852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.592539 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1367/2697] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:56.600923 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.602481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.669780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b108f3c-cc8d-4101-990e-ee62a608dfe7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.674249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.675121 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.675403 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.675677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] PATH_INFO: `/v3/projects/27ae0587040c496e937602c753358824` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.676883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ae0587040c496e937602c753358824)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.678817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.726389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ae0587040c496e937602c753358824', 'request_id': 'req-a602814d-a6ef-4b21-8104-6dfb549ba6a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.732849 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ae0587040c496e937602c753358824', 'request_id': 'req-a602814d-a6ef-4b21-8104-6dfb549ba6a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.741411 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ae0587040c496e937602c753358824', 'request_id': 'req-a602814d-a6ef-4b21-8104-6dfb549ba6a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.753213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] The token cache is being invalidate because project 27ae0587040c496e937602c753358824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:56.753498 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.754151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.755828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1331/2698] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:56 2022] DELETE /identity/v3/projects/27ae0587040c496e937602c753358824 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:56.759959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:56.773025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899241-d536-42bb-b0a0-ed1ef53c946c service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:56.832718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:56.834038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.834484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.834762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] PATH_INFO: `/v3/users/59e1d691bf97464fbca7752a6dbb91d2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.836032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e1d691bf97464fbca7752a6dbb91d2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:56.849747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:56.911226 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e1d691bf97464fbca7752a6dbb91d2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.934755 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e1d691bf97464fbca7752a6dbb91d2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.950665 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e1d691bf97464fbca7752a6dbb91d2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.958589 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e1d691bf97464fbca7752a6dbb91d2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.959949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e1d691bf97464fbca7752a6dbb91d2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:56.966963 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1368/2699] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:56 2022] DELETE /identity/v3/users/59e1d691bf97464fbca7752a6dbb91d2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:57.264170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:57.265960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.280504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602814d-a6ef-4b21-8104-6dfb549ba6a8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:57.343288 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:57.344097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.344745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.346289 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] PATH_INFO: `/v3/projects/0cc6aedc57bb446ca161110c5c6c693c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.348301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc6aedc57bb446ca161110c5c6c693c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:57.350295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:57.401839 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc6aedc57bb446ca161110c5c6c693c', 'request_id': 'req-556b46e2-0e89-450c-8931-4161aa4fad02'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.408607 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc6aedc57bb446ca161110c5c6c693c', 'request_id': 'req-556b46e2-0e89-450c-8931-4161aa4fad02'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.418836 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc6aedc57bb446ca161110c5c6c693c', 'request_id': 'req-556b46e2-0e89-450c-8931-4161aa4fad02'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.429344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] The token cache is being invalidate because project 0cc6aedc57bb446ca161110c5c6c693c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:57.429631 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.430296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.431911 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1332/2700] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:57 2022] DELETE /identity/v3/projects/0cc6aedc57bb446ca161110c5c6c693c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:57.435966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:57.437440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.450322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13b65f-fbc1-47ca-88a0-68686253538b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:57.508448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:57.509336 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.509623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.509898 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] PATH_INFO: `/v3/users/79b0cd23948946f799c28d08eb071987` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.511105 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b0cd23948946f799c28d08eb071987)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:57.514014 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:57.562230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b0cd23948946f799c28d08eb071987'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.570264 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b0cd23948946f799c28d08eb071987'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.581606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b0cd23948946f799c28d08eb071987'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.588125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b0cd23948946f799c28d08eb071987'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.588728 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1061bb4f-58b5-4b5c-a2d9-668524d4881a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b0cd23948946f799c28d08eb071987'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.594773 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1369/2701] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:57 2022] DELETE /identity/v3/users/79b0cd23948946f799c28d08eb071987 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:57.876421 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:57.877964 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.890680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b46e2-0e89-450c-8931-4161aa4fad02 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:57.949991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:57.950802 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.951063 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.951339 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] PATH_INFO: `/v3/projects/48756f06f870410485e67145fc358495` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.952648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48756f06f870410485e67145fc358495)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:57.954557 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.003278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48756f06f870410485e67145fc358495', 'request_id': 'req-cc1cdc5c-b403-4deb-8c85-6f470942873d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.009354 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48756f06f870410485e67145fc358495', 'request_id': 'req-cc1cdc5c-b403-4deb-8c85-6f470942873d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.018834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48756f06f870410485e67145fc358495', 'request_id': 'req-cc1cdc5c-b403-4deb-8c85-6f470942873d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.033428 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] The token cache is being invalidate because project 48756f06f870410485e67145fc358495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:58.033728 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.034388 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.036413 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1333/2702] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:57 2022] DELETE /identity/v3/projects/48756f06f870410485e67145fc358495 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:58.042713 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000bbd-699b-401e-8448-018fb4acc81a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.043686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000bbd-699b-401e-8448-018fb4acc81a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.044074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000bbd-699b-401e-8448-018fb4acc81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.046618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.048358 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.065401 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d9000bbd-699b-401e-8448-018fb4acc81a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:58.066610 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d9000bbd-699b-401e-8448-018fb4acc81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.126117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cdc5c-b403-4deb-8c85-6f470942873d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.131998 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.132920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.133227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.133499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] PATH_INFO: `/v3/users/cd4bbc59894445d4b5e46ab6cabb1c97` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.134763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4bbc59894445d4b5e46ab6cabb1c97)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.137272 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.143143 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1370/2703] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:58.152647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5abb-18f7-4727-a59d-d4e4d6d243f2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.153174 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5abb-18f7-4727-a59d-d4e4d6d243f2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.153666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5abb-18f7-4727-a59d-d4e4d6d243f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.176273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e1dd5abb-18f7-4727-a59d-d4e4d6d243f2 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:58.178031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e1dd5abb-18f7-4727-a59d-d4e4d6d243f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.187321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1371/2704] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:58.191284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5abb-18f7-4727-a59d-d4e4d6d243f2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.191624 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4bbc59894445d4b5e46ab6cabb1c97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.199380 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4bbc59894445d4b5e46ab6cabb1c97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.200285 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4bbc59894445d4b5e46ab6cabb1c97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.201643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5abb-18f7-4727-a59d-d4e4d6d243f2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.206628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.207299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.207584 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.207854 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.208617 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:58.209012 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.210518 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.213166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4bbc59894445d4b5e46ab6cabb1c97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.213830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a55fd16-6ff9-403f-9dea-d9a5e7621bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4bbc59894445d4b5e46ab6cabb1c97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.224398 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1372/2705] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:05:58.228883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.231237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.233777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1334/2706] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:05:58 2022] DELETE /identity/v3/users/cd4bbc59894445d4b5e46ab6cabb1c97 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:58.238036 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.238326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.238605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.248599 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597ff4-1d06-40e3-a8d7-ebcecc7990ed admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.255620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:58.256742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.313429 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.314178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.314527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.314872 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.315675 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.319788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1335/2707] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:58.320364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.327691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.329139 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.349187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1373/2708] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:58.353098 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.395853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349d28-76d2-4595-a1f2-95882d34cc8d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.430588 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818445-c7fc-4476-8852-e4fcdfc74ab7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.436479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.437292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.437731 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.438237 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.439910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.442042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.450037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.450705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.450991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.451266 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.467824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.471725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.480315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1374/2709] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:58.484566 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.487211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1336/2710] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:58.496127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a07ca-cc80-4f7f-8575-bc6cbd97e41f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.501394 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.502148 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.502439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.502724 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.503679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.505376 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.522173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1375/2711] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:05:58.526258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.541772 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc02e6-fd37-40d7-8ad1-6e0df40d821c service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.548979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c05d3a-bccd-445d-ada9-f671f91db138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.549777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05d3a-bccd-445d-ada9-f671f91db138 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.550110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05d3a-bccd-445d-ada9-f671f91db138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.550434 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05d3a-bccd-445d-ada9-f671f91db138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.551178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c05d3a-bccd-445d-ada9-f671f91db138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.552993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c05d3a-bccd-445d-ada9-f671f91db138 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.565187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1337/2712] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:58.570074 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.581413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0aa04-0bfc-4bd1-b945-cc5f5041ffa2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.586307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.587194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.587481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.587762 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] PATH_INFO: `/v3/projects/181b4211f325464eafdf342437204999/users/41bd5118ac0e4f7b8e81b4451c6a6da0/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.605410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181b4211f325464eafdf342437204999, user_id=41bd5118ac0e4f7b8e81b4451c6a6da0, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.608289 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.622314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1376/2713] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:58 2022] PUT /identity/v3/projects/181b4211f325464eafdf342437204999/users/41bd5118ac0e4f7b8e81b4451c6a6da0/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:58.633945 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.634162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.634439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.663603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] MFA Rules not processed for user `41bd5118ac0e4f7b8e81b4451c6a6da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:58.665078 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.733537 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1338/2714] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:58.737889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.776183 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.778039 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:58.803298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1be54a-26f8-4093-a684-9c021ac4d2e3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.808349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.809022 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.809303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.809576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.810308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.812370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.842183 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1377/2715] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:58.846368 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.856587 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b3759-e148-4962-b01a-95d7c66dc7a7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.907526 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5668e-efd0-4b2b-bb04-1c64088b422c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.909719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.910592 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.910882 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.911155 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] PATH_INFO: `/v3/projects/1c23384b87b5400ea4b4e19aa265d33d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.912481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c23384b87b5400ea4b4e19aa265d33d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.912758 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.913407 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.913684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.913951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.914406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.914637 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.916568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.941867 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1378/2716] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:58.943273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.953775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9f00b-7e6b-41fd-b651-44ce65a4133d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.962519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c23384b87b5400ea4b4e19aa265d33d', 'request_id': 'req-d5edbfc9-8311-4fca-a48c-087e46e74b78'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.969463 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c23384b87b5400ea4b4e19aa265d33d', 'request_id': 'req-d5edbfc9-8311-4fca-a48c-087e46e74b78'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.979824 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c23384b87b5400ea4b4e19aa265d33d', 'request_id': 'req-d5edbfc9-8311-4fca-a48c-087e46e74b78'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.990064 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] The token cache is being invalidate because project 1c23384b87b5400ea4b4e19aa265d33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:58.990351 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.990985 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d5edbfc9-8311-4fca-a48c-087e46e74b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:58.992579 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1339/2717] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:05:58 2022] DELETE /identity/v3/projects/1c23384b87b5400ea4b4e19aa265d33d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:58.998168 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.998506 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.998888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.015708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0f7a-41d2-40fb-86a5-695a1d8d8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.016424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0f7a-41d2-40fb-86a5-695a1d8d8ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.016830 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0f7a-41d2-40fb-86a5-695a1d8d8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.017024 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0f7a-41d2-40fb-86a5-695a1d8d8ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.017501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:59.017693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0f7a-41d2-40fb-86a5-695a1d8d8ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.018414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.019273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0f7a-41d2-40fb-86a5-695a1d8d8ddf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.029186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1340/2718] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:59.033085 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1379/2719] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:59.036304 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.036841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe6dd-41a2-43a0-963d-b0bfe19a6009 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.037131 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe6dd-41a2-43a0-963d-b0bfe19a6009 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.037409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe6dd-41a2-43a0-963d-b0bfe19a6009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.037752 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.049548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb256-1dff-4cb0-bc95-9f4c9bf0a99d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.054348 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.055230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.055514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.055789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] PATH_INFO: `/v3/projects/ca66301d932940c899f062e8025fd7bd/users/4f434bba6fba4bd7b2b443420c543f8e/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.055920 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f1dbe6dd-41a2-43a0-963d-b0bfe19a6009 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:59.057114 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f1dbe6dd-41a2-43a0-963d-b0bfe19a6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.065815 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1380/2720] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:59.069969 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe6dd-41a2-43a0-963d-b0bfe19a6009 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.070738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca66301d932940c899f062e8025fd7bd, user_id=4f434bba6fba4bd7b2b443420c543f8e, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.073558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.078992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe6dd-41a2-43a0-963d-b0bfe19a6009 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.084575 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.085229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.085514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.085785 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.086548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:59.086853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.088414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1341/2721] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:59 2022] PUT /identity/v3/projects/ca66301d932940c899f062e8025fd7bd/users/4f434bba6fba4bd7b2b443420c543f8e/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:59.088554 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.092771 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.101204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1381/2722] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:59.105658 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.114852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ffa0-38d7-4aa7-b109-fcae36bfc768 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.159541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e584d-f7bb-4222-ac98-59e0b3ba39ba admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.164515 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.165298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.165659 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.166030 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.166766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.168591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.169409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.170068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.170353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.170641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.171361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.173266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.178900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1342/2723] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:59.183696 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.193455 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c5e0-c34d-4faa-aca8-c20af5f07249 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.198906 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d2f46-6cee-402a-b48a-e6724fea9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.199892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d2f46-6cee-402a-b48a-e6724fea9507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.200196 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d2f46-6cee-402a-b48a-e6724fea9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.200482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d2f46-6cee-402a-b48a-e6724fea9507 admin admin] PATH_INFO: `/v3/projects/ca66301d932940c899f062e8025fd7bd/users/4f434bba6fba4bd7b2b443420c543f8e/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.203937 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1382/2724] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:05:59 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:59.205953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d2f46-6cee-402a-b48a-e6724fea9507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca66301d932940c899f062e8025fd7bd, user_id=4f434bba6fba4bd7b2b443420c543f8e, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.206100 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.208792 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d2f46-6cee-402a-b48a-e6724fea9507 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.219956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1343/2725] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:59 2022] PUT /identity/v3/projects/ca66301d932940c899f062e8025fd7bd/users/4f434bba6fba4bd7b2b443420c543f8e/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:59.232814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.233225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.233512 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.261868 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] MFA Rules not processed for user `4f434bba6fba4bd7b2b443420c543f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:59.263081 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.267316 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dbb6a-7363-4bef-979a-aa57aa2ed14d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.321913 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.322592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.322884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.323155 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.324037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.326009 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.330404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1344/2726] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:59.346153 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.348200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.350321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1383/2727] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:05:59 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:59.356223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.370533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979648-ebb4-4128-bb6d-17e7ea9cd32b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.376457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.377127 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.377409 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.377683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.378411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.380056 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.390476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1384/2728] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:05:59.394676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.405120 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d702-c50b-4533-85c3-c3ffae096798 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.410607 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.411282 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.411640 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.412021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.412825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.413198 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f09831-940a-4b5b-9008-7cb4ea9496f5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.414579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.417056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.417745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.418027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.418299 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.427129 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1385/2729] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:59.428080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.429527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.431353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.439683 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1345/2730] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:59.441763 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b6dcc-45cd-48f3-8b61-b40925addb93 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.446700 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5955af-eca8-4049-813c-79fe10902353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.447578 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5955af-eca8-4049-813c-79fe10902353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.447858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5955af-eca8-4049-813c-79fe10902353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.448161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5955af-eca8-4049-813c-79fe10902353 admin admin] PATH_INFO: `/v3/projects/76d2cdfd3aac43e3bb71ae6dda71da82/users/f713f767dbf14d10b9100ea52d093d6b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.463594 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5955af-eca8-4049-813c-79fe10902353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d2cdfd3aac43e3bb71ae6dda71da82, user_id=f713f767dbf14d10b9100ea52d093d6b, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.466995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5955af-eca8-4049-813c-79fe10902353 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.487636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.488222 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1386/2731] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:05:59 2022] PUT /identity/v3/projects/76d2cdfd3aac43e3bb71ae6dda71da82/users/f713f767dbf14d10b9100ea52d093d6b/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:59.493189 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.493479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.493757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.501002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df23d-308f-48eb-8403-7076ef489894 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.512541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:59.513841 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.562667 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.563448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.563734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.564815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.567344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.578897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1387/2732] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:59.588284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.590193 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.639453 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.641542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.652749 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9e59-0f0d-48ed-b68c-60509d7ae15a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.653060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1346/2733] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:59.656816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4f9a-2165-4f0e-b7e3-001525495bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.657473 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4f9a-2165-4f0e-b7e3-001525495bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.657784 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4f9a-2165-4f0e-b7e3-001525495bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.658015 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4f9a-2165-4f0e-b7e3-001525495bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.672215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4f9a-2165-4f0e-b7e3-001525495bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.673806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4f9a-2165-4f0e-b7e3-001525495bc8 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.691196 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1388/2734] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:03.122238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:03.191578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342e47d-9241-457b-b489-6a6a72d9c296 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:03.197445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:03.198356 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:03.199141 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:03.199481 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] PATH_INFO: `/v3/users/41bd5118ac0e4f7b8e81b4451c6a6da0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:03.200853 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bd5118ac0e4f7b8e81b4451c6a6da0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:03.203090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:03.282848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bd5118ac0e4f7b8e81b4451c6a6da0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.291145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bd5118ac0e4f7b8e81b4451c6a6da0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.292447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bd5118ac0e4f7b8e81b4451c6a6da0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.311189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bd5118ac0e4f7b8e81b4451c6a6da0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.312379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bd5118ac0e4f7b8e81b4451c6a6da0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.336343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1347/2735] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:03 2022] DELETE /identity/v3/users/41bd5118ac0e4f7b8e81b4451c6a6da0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:03.340660 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80c07-94c1-4c74-8295-652345034727 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:03.341177 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80c07-94c1-4c74-8295-652345034727 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:03.342615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80c07-94c1-4c74-8295-652345034727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:03.416996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-37a80c07-94c1-4c74-8295-652345034727 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:03.418458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-37a80c07-94c1-4c74-8295-652345034727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:03.563497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1389/2736] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:03.570189 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:03.572080 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:03.697514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2639e4f-ad1e-4b92-b45c-0bf9d7f8523e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:03.701627 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e7df-ae40-45b1-891e-cce64f5c93ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:03.702294 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e7df-ae40-45b1-891e-cce64f5c93ee service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:03.702578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e7df-ae40-45b1-891e-cce64f5c93ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:03.702854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e7df-ae40-45b1-891e-cce64f5c93ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:03.713878 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e7df-ae40-45b1-891e-cce64f5c93ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:03.715478 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e7df-ae40-45b1-891e-cce64f5c93ee service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:03.730145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1348/2737] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:04.076444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a80c07-94c1-4c74-8295-652345034727 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.078067 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-37a80c07-94c1-4c74-8295-652345034727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.098884 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a80c07-94c1-4c74-8295-652345034727 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.106928 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.108052 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.110950 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.111238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] PATH_INFO: `/v3/projects/181b4211f325464eafdf342437204999` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.113962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=181b4211f325464eafdf342437204999)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.115915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.156803 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.157236 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.157502 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.180974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181b4211f325464eafdf342437204999', 'request_id': 'req-353baa74-8941-44af-a376-2a84778f43f8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.186499 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] MFA Rules not processed for user `f713f767dbf14d10b9100ea52d093d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:04.187577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181b4211f325464eafdf342437204999', 'request_id': 'req-353baa74-8941-44af-a376-2a84778f43f8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.187702 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.211118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181b4211f325464eafdf342437204999', 'request_id': 'req-353baa74-8941-44af-a376-2a84778f43f8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.227707 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] The token cache is being invalidate because project 181b4211f325464eafdf342437204999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:04.228031 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.228732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.234091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1390/2738] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:04 2022] DELETE /identity/v3/projects/181b4211f325464eafdf342437204999 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:04.240072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.241565 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.269949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1349/2739] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:04.274494 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.276054 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.313424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353baa74-8941-44af-a376-2a84778f43f8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.318570 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.319489 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.319807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.320243 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] PATH_INFO: `/v3/users/4f434bba6fba4bd7b2b443420c543f8e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.321875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f434bba6fba4bd7b2b443420c543f8e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.324032 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.345887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068b269-b015-4f07-b50e-2dd3e077c4d0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.352603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.353353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.353640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.353922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.355222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.357414 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.378320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f434bba6fba4bd7b2b443420c543f8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.391100 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1350/2740] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:04 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:04.391333 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f434bba6fba4bd7b2b443420c543f8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.392186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.402881 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f434bba6fba4bd7b2b443420c543f8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.410399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f434bba6fba4bd7b2b443420c543f8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.411164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f434bba6fba4bd7b2b443420c543f8e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.417540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1391/2741] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:04 2022] DELETE /identity/v3/users/4f434bba6fba4bd7b2b443420c543f8e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:04.457748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f696e-7a15-45e0-bdab-c891205c22e7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.527813 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.528605 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.528959 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.529301 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.530116 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.533293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.566128 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1351/2742] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:04 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:04.570194 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.572329 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.587467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9f8ef-6eff-4109-826b-5951b78b1cd1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.595957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.597184 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.597672 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.598095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.599062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.600890 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.616097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1392/2743] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:04.617918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.629042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f77d5-fa64-4447-9502-98c73f03e87c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.635794 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.637024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.637347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.637688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] PATH_INFO: `/v3/projects/08ca871baa4544fc8d3bbb3e758a346c/users/abd41b7cc2924182af5c3093824ebc3e/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.661600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ca871baa4544fc8d3bbb3e758a346c, user_id=abd41b7cc2924182af5c3093824ebc3e, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.664437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.687020 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1352/2744] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:04 2022] PUT /identity/v3/projects/08ca871baa4544fc8d3bbb3e758a346c/users/abd41b7cc2924182af5c3093824ebc3e/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:04.691214 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.701541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8907-ef13-4308-ac19-5dfd08e5925d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.785280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.796551 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.847187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.847932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.848206 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.848479 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.849320 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.850802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.867908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1393/2745] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:04.870902 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.881944 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f69752-cd59-4826-a5da-4dce1a346254 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.886875 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33d6c-ebc4-4fa0-a1ac-608dfbf37a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.887794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33d6c-ebc4-4fa0-a1ac-608dfbf37a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.888118 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33d6c-ebc4-4fa0-a1ac-608dfbf37a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.888403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33d6c-ebc4-4fa0-a1ac-608dfbf37a0a admin admin] PATH_INFO: `/v3/projects/08ca871baa4544fc8d3bbb3e758a346c/users/abd41b7cc2924182af5c3093824ebc3e/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.890438 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33d6c-ebc4-4fa0-a1ac-608dfbf37a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ca871baa4544fc8d3bbb3e758a346c, user_id=abd41b7cc2924182af5c3093824ebc3e, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.890750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df4c3-f99d-4618-9fb0-7d6a37bf0891 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.893402 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33d6c-ebc4-4fa0-a1ac-608dfbf37a0a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.896334 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.897437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.897952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.898417 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] PATH_INFO: `/v3/projects/ca66301d932940c899f062e8025fd7bd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.899830 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca66301d932940c899f062e8025fd7bd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.901937 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.905699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1394/2746] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:04 2022] PUT /identity/v3/projects/08ca871baa4544fc8d3bbb3e758a346c/users/abd41b7cc2924182af5c3093824ebc3e/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:04.959432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca66301d932940c899f062e8025fd7bd', 'request_id': 'req-564d39c2-2b97-4bd6-894d-2fc342224e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.966374 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca66301d932940c899f062e8025fd7bd', 'request_id': 'req-564d39c2-2b97-4bd6-894d-2fc342224e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.976449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca66301d932940c899f062e8025fd7bd', 'request_id': 'req-564d39c2-2b97-4bd6-894d-2fc342224e25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.989688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] The token cache is being invalidate because project ca66301d932940c899f062e8025fd7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:04.990245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.991056 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-564d39c2-2b97-4bd6-894d-2fc342224e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:04.993154 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1353/2747] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:04 2022] DELETE /identity/v3/projects/ca66301d932940c899f062e8025fd7bd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:04.999390 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48baf-1304-438b-bd72-1cdce55b43d7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.999680 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48baf-1304-438b-bd72-1cdce55b43d7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.000000 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48baf-1304-438b-bd72-1cdce55b43d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.054803 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1ab48baf-1304-438b-bd72-1cdce55b43d7 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:05.056217 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1ab48baf-1304-438b-bd72-1cdce55b43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.131560 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1395/2748] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:05.139589 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ae8e-560f-4f0e-b2ff-cfc10ff276dd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.140026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ae8e-560f-4f0e-b2ff-cfc10ff276dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.140293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ae8e-560f-4f0e-b2ff-cfc10ff276dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.159732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fb03ae8e-560f-4f0e-b2ff-cfc10ff276dd None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:05.161061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fb03ae8e-560f-4f0e-b2ff-cfc10ff276dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.177485 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1354/2749] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:05.181844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab48baf-1304-438b-bd72-1cdce55b43d7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.192751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab48baf-1304-438b-bd72-1cdce55b43d7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.197743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.198359 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.198775 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.199058 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.199966 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:05.200279 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.202068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.220902 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03ae8e-560f-4f0e-b2ff-cfc10ff276dd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.228042 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1396/2750] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:05.231351 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03ae8e-560f-4f0e-b2ff-cfc10ff276dd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.237208 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.238208 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.238486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.238859 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.239697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.242069 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.279816 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1355/2751] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:05.284544 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.301317 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e62a61-6916-4d44-8bfb-cefb9a4d3cfc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.370612 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.371647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.372138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.372631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.373550 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.375697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.404095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1397/2752] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:05.404865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.417889 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa127006-b6fb-4691-9a18-f4d23f6873a2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.425887 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.426697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.427071 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.427438 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.428359 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.430061 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.443832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1356/2753] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:05.448182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.459039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c6443-ff88-4208-b53a-9fe00aa195fa admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.464595 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cfd4e-8cc5-4254-b402-b2e344720669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.466072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cfd4e-8cc5-4254-b402-b2e344720669 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.466072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cfd4e-8cc5-4254-b402-b2e344720669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.466072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cfd4e-8cc5-4254-b402-b2e344720669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.466752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cfd4e-8cc5-4254-b402-b2e344720669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.468423 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cfd4e-8cc5-4254-b402-b2e344720669 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.481374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1398/2754] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:05.485305 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.496615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e79d6-b3b7-4054-83d6-a6ffef802bc2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.501741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.502733 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.503106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.503511 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] PATH_INFO: `/v3/projects/700464fa57ab4e5695ab20d3c8ba9cfc/users/ce3fb9f8e43740f2ae52b4fb1347149e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.521038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700464fa57ab4e5695ab20d3c8ba9cfc, user_id=ce3fb9f8e43740f2ae52b4fb1347149e, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.523734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.538971 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1357/2755] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:05 2022] PUT /identity/v3/projects/700464fa57ab4e5695ab20d3c8ba9cfc/users/ce3fb9f8e43740f2ae52b4fb1347149e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:05.550499 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c13f4-f9d2-42eb-976f-5c813fe73e75 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.550896 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c13f4-f9d2-42eb-976f-5c813fe73e75 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.551364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c13f4-f9d2-42eb-976f-5c813fe73e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.585576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a56c13f4-f9d2-42eb-976f-5c813fe73e75 None None] MFA Rules not processed for user `ce3fb9f8e43740f2ae52b4fb1347149e`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:05.586817 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a56c13f4-f9d2-42eb-976f-5c813fe73e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.667921 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1399/2756] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:05.672300 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.758132 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caad44a-4958-40ba-bce6-22338feabf32 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.763333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.764118 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.764477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.764827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.765618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.767635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.800215 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1358/2757] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:05.801433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c13f4-f9d2-42eb-976f-5c813fe73e75 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.814095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c13f4-f9d2-42eb-976f-5c813fe73e75 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.891134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.891959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.892207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.892576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.893374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.895714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.918361 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1400/2758] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/users => generated 307 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:05.921992 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.932444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de283a-050f-40ce-898e-a0dbfee20b0d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.937234 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.937997 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.938344 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.938681 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.939473 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.941213 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.955966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1359/2759] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:05.957151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.975418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7d523-30eb-460e-b83d-10055f0375be admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.980790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.981776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.982128 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.982481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] PATH_INFO: `/v3/projects/98a40b4b55be4ef0be098e656f813b06/users/8dfd4ae776f941c8a067f994e5034e55/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.999929 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a40b4b55be4ef0be098e656f813b06, user_id=8dfd4ae776f941c8a067f994e5034e55, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.002789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.021646 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1401/2760] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:05 2022] PUT /identity/v3/projects/98a40b4b55be4ef0be098e656f813b06/users/8dfd4ae776f941c8a067f994e5034e55/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:06.026892 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.041903 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4210ab-4d47-4191-b38d-063072aa17b5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.118542 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b548c04-04a1-48fa-8889-8326885fb32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.119657 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b548c04-04a1-48fa-8889-8326885fb32d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.120492 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b548c04-04a1-48fa-8889-8326885fb32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.121151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b548c04-04a1-48fa-8889-8326885fb32d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.122066 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b548c04-04a1-48fa-8889-8326885fb32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.124546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b548c04-04a1-48fa-8889-8326885fb32d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.141700 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1360/2761] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:06.143001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.159447 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fd799-bcb0-44d7-8100-a8116c79665b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.165546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.166652 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.166947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.167244 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] PATH_INFO: `/v3/projects/98a40b4b55be4ef0be098e656f813b06/users/8dfd4ae776f941c8a067f994e5034e55/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.169564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a40b4b55be4ef0be098e656f813b06, user_id=8dfd4ae776f941c8a067f994e5034e55, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.172462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.199930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1402/2762] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:06 2022] PUT /identity/v3/projects/98a40b4b55be4ef0be098e656f813b06/users/8dfd4ae776f941c8a067f994e5034e55/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:06.201837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637cb2b-51ac-43f2-bd7e-7a2a8ce91c74 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.202366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637cb2b-51ac-43f2-bd7e-7a2a8ce91c74 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.202366 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637cb2b-51ac-43f2-bd7e-7a2a8ce91c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.239761 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3637cb2b-51ac-43f2-bd7e-7a2a8ce91c74 None None] MFA Rules not processed for user `8dfd4ae776f941c8a067f994e5034e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:06.241723 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3637cb2b-51ac-43f2-bd7e-7a2a8ce91c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:06.327658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1361/2763] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:06.343947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.346358 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:06.414961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08733f96-5f2a-42b5-9463-134ad573afe7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.420457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbe813-0a73-4e0d-8cf3-218863237744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.421133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe813-0a73-4e0d-8cf3-218863237744 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.421417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe813-0a73-4e0d-8cf3-218863237744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.421693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe813-0a73-4e0d-8cf3-218863237744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.435221 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbe813-0a73-4e0d-8cf3-218863237744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.436704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbe813-0a73-4e0d-8cf3-218863237744 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.452296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1403/2764] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:06.574295 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637cb2b-51ac-43f2-bd7e-7a2a8ce91c74 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.606489 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637cb2b-51ac-43f2-bd7e-7a2a8ce91c74 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.630637 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.631966 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.632429 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.632894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.733594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.735226 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.777795 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1362/2765] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:09.447397 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002931-3329-4f43-956e-2a6db2d78abc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.448467 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002931-3329-4f43-956e-2a6db2d78abc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.448965 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002931-3329-4f43-956e-2a6db2d78abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.482319 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2d002931-3329-4f43-956e-2a6db2d78abc None None] MFA Rules not processed for user `abd41b7cc2924182af5c3093824ebc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:09.484263 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2d002931-3329-4f43-956e-2a6db2d78abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.595260 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1404/2766] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:09.610225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.612230 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.721022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a189647-6281-429f-9e30-4b452eaab47d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.732991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7124a3-e870-4581-9bd5-806672784091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.734484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7124a3-e870-4581-9bd5-806672784091 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.734484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7124a3-e870-4581-9bd5-806672784091 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.734484 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7124a3-e870-4581-9bd5-806672784091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.736686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2e7124a3-e870-4581-9bd5-806672784091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.828949 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7124a3-e870-4581-9bd5-806672784091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.830890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7124a3-e870-4581-9bd5-806672784091 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.843046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1363/2767] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:12.445964 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002931-3329-4f43-956e-2a6db2d78abc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:12.523303 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002931-3329-4f43-956e-2a6db2d78abc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:12.528476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:12.529315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:12.529673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:12.529954 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] PATH_INFO: `/v3/users/ce3fb9f8e43740f2ae52b4fb1347149e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:12.531151 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3fb9f8e43740f2ae52b4fb1347149e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:12.533124 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:12.606082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3fb9f8e43740f2ae52b4fb1347149e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:12.622601 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3fb9f8e43740f2ae52b4fb1347149e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:12.639097 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3fb9f8e43740f2ae52b4fb1347149e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:12.649328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3fb9f8e43740f2ae52b4fb1347149e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:12.649328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3fb9f8e43740f2ae52b4fb1347149e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:12.655910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1405/2768] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:12 2022] DELETE /identity/v3/users/ce3fb9f8e43740f2ae52b4fb1347149e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:12.658643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:12.659115 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:12.659778 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:12.677433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:12.678834 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:12.749065 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1364/2769] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:12.761888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:12.763797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:12.827622 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca4c3f-fcaa-4da1-b4bd-084e1feea929 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:12.831389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:12.832167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:12.832536 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:12.832886 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:12.843908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:12.845508 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:12.857486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1406/2770] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:13.171567 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:13.173090 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:13.186378 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1fdf-b2fa-43ca-ae90-b8e0e3c576eb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:13.191826 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:13.193719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:13.194396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:13.194893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] PATH_INFO: `/v3/projects/700464fa57ab4e5695ab20d3c8ba9cfc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:13.197120 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700464fa57ab4e5695ab20d3c8ba9cfc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:13.199975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:13.279623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700464fa57ab4e5695ab20d3c8ba9cfc', 'request_id': 'req-eaee61c8-0f9f-4461-96e8-3f6390e92323'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.294504 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700464fa57ab4e5695ab20d3c8ba9cfc', 'request_id': 'req-eaee61c8-0f9f-4461-96e8-3f6390e92323'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.309535 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700464fa57ab4e5695ab20d3c8ba9cfc', 'request_id': 'req-eaee61c8-0f9f-4461-96e8-3f6390e92323'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.333275 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] The token cache is being invalidate because project 700464fa57ab4e5695ab20d3c8ba9cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:13.333576 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.334734 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.337669 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1365/2771] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:13 2022] DELETE /identity/v3/projects/700464fa57ab4e5695ab20d3c8ba9cfc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:13.341744 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:13.361133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5a6d3-2816-4f04-a39b-90a003898826 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:13.449947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:13.452628 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:13.453096 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:13.453548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] PATH_INFO: `/v3/users/8dfd4ae776f941c8a067f994e5034e55` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:13.456161 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfd4ae776f941c8a067f994e5034e55)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:13.462618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:13.535147 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfd4ae776f941c8a067f994e5034e55'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.565452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfd4ae776f941c8a067f994e5034e55'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.584686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfd4ae776f941c8a067f994e5034e55'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.592321 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfd4ae776f941c8a067f994e5034e55'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.594087 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-afdc2acd-43b1-473f-8c6f-9a01339cba73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfd4ae776f941c8a067f994e5034e55'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:13.602399 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1407/2772] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:13 2022] DELETE /identity/v3/users/8dfd4ae776f941c8a067f994e5034e55 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:14.081649 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.083493 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:14.104534 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee61c8-0f9f-4461-96e8-3f6390e92323 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.174037 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.175333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.175620 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.175926 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] PATH_INFO: `/v3/projects/98a40b4b55be4ef0be098e656f813b06` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.177122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a40b4b55be4ef0be098e656f813b06)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.179291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.228895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a40b4b55be4ef0be098e656f813b06', 'request_id': 'req-4c8a32ac-54da-4438-8f99-6f324efd4ca8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.236166 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a40b4b55be4ef0be098e656f813b06', 'request_id': 'req-4c8a32ac-54da-4438-8f99-6f324efd4ca8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.246940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a40b4b55be4ef0be098e656f813b06', 'request_id': 'req-4c8a32ac-54da-4438-8f99-6f324efd4ca8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.261212 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] The token cache is being invalidate because project 98a40b4b55be4ef0be098e656f813b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:14.261604 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.262373 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4c8a32ac-54da-4438-8f99-6f324efd4ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.264372 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1366/2773] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:14 2022] DELETE /identity/v3/projects/98a40b4b55be4ef0be098e656f813b06 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:14.269170 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a55b5-afe9-4160-b3d9-7ce419946c7e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.269547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a55b5-afe9-4160-b3d9-7ce419946c7e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.269739 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a55b5-afe9-4160-b3d9-7ce419946c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.290460 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0c1a55b5-afe9-4160-b3d9-7ce419946c7e None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:14.292133 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0c1a55b5-afe9-4160-b3d9-7ce419946c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:14.357621 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1408/2774] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:14.365549 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0df3c3-05ac-4989-a47c-376ae0292ccf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.365912 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0df3c3-05ac-4989-a47c-376ae0292ccf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.366187 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0df3c3-05ac-4989-a47c-376ae0292ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.387108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8f0df3c3-05ac-4989-a47c-376ae0292ccf None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:14.388353 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8f0df3c3-05ac-4989-a47c-376ae0292ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:14.397444 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1367/2775] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:14.404631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a55b5-afe9-4160-b3d9-7ce419946c7e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.415819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a55b5-afe9-4160-b3d9-7ce419946c7e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.421451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.422146 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.422431 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.422708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.423457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:14.423769 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.425427 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.440026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1409/2776] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:14.443169 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0df3c3-05ac-4989-a47c-376ae0292ccf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.452848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0df3c3-05ac-4989-a47c-376ae0292ccf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.457677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.459832 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.460227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.460577 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.461315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.463518 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.496544 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1368/2777] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:14 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:14.497761 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.509314 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7714146-b78c-4ec8-9ab0-f69bb11ffa51 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.573175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.574239 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.574701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.575134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.576362 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.578166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.611424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1410/2778] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:14 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:14.615610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.630247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66037-fe10-48ef-85dd-48f4ed53ba80 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.635097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.636156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.636448 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.636725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.637467 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.639094 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.652547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1369/2779] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:14.656579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.667099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7324b5e-5941-4b95-9bfb-2def5cc25f57 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.673292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc568c1a-0b12-452c-a07c-ca58d1086189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.674457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc568c1a-0b12-452c-a07c-ca58d1086189 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.674703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc568c1a-0b12-452c-a07c-ca58d1086189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.675134 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc568c1a-0b12-452c-a07c-ca58d1086189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.676137 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc568c1a-0b12-452c-a07c-ca58d1086189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.678116 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc568c1a-0b12-452c-a07c-ca58d1086189 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.692181 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1411/2780] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:14.693682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.704920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3864d-a104-43f6-b766-8c4d355823f6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.711466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.711894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.712193 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.712677 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] PATH_INFO: `/v3/projects/207dd8ea4b4742019c3642e57c2d049c/users/778b6c3ebd9a4555ad62dd87877464ef/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.731559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207dd8ea4b4742019c3642e57c2d049c, user_id=778b6c3ebd9a4555ad62dd87877464ef, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.734326 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.755918 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1370/2781] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:14 2022] PUT /identity/v3/projects/207dd8ea4b4742019c3642e57c2d049c/users/778b6c3ebd9a4555ad62dd87877464ef/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:14.765906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf257d-99ff-43a3-86a5-bf6451391b54 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.766200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf257d-99ff-43a3-86a5-bf6451391b54 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.766571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf257d-99ff-43a3-86a5-bf6451391b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.797301 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-37bf257d-99ff-43a3-86a5-bf6451391b54 None None] MFA Rules not processed for user `778b6c3ebd9a4555ad62dd87877464ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:14.798559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-37bf257d-99ff-43a3-86a5-bf6451391b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:14.868819 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1412/2782] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:14.873818 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.952672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c41197-9dd5-4321-b2bf-da45c25df5a4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.959031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.959732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.960108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.960396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.961099 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.963035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.995919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1371/2783] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:14 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:14.998391 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf257d-99ff-43a3-86a5-bf6451391b54 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:15.010298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf257d-99ff-43a3-86a5-bf6451391b54 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:15.070444 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:15.071132 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.071413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.071684 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.072436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:15.074478 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:15.097023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1413/2784] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:14 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:15.101895 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:15.113093 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588212f8-394b-49b4-a681-e89cb87aa82c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:15.118545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:15.119258 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.119523 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.119850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.120648 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:15.122267 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:15.133309 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1372/2785] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:15.138995 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:15.150370 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbfc9-8173-4b84-a546-23b7cbce7186 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:15.156123 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:15.157053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.157340 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.157596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] PATH_INFO: `/v3/projects/e2a5752cb8ff415f83a87bb09acd45b5/users/cea56b2f91a347bfae732c2ebb17ba23/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.174353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a5752cb8ff415f83a87bb09acd45b5, user_id=cea56b2f91a347bfae732c2ebb17ba23, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:15.177558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:15.196229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1414/2786] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:15 2022] PUT /identity/v3/projects/e2a5752cb8ff415f83a87bb09acd45b5/users/cea56b2f91a347bfae732c2ebb17ba23/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:15.200798 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:15.214560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1511-ce70-48fe-a91c-c55105978c6c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:15.281789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d91e2-d826-4c63-8053-836fad46ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:15.282469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d91e2-d826-4c63-8053-836fad46ebbf admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.282754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d91e2-d826-4c63-8053-836fad46ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.283028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d91e2-d826-4c63-8053-836fad46ebbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.283745 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d91e2-d826-4c63-8053-836fad46ebbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:15.285406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d91e2-d826-4c63-8053-836fad46ebbf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:15.295977 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1373/2787] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:15.300625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:15.311305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d94b2-19e6-46b6-b2e3-88706277a7f9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:15.317283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:15.318235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.318529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.318807 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] PATH_INFO: `/v3/projects/e2a5752cb8ff415f83a87bb09acd45b5/users/cea56b2f91a347bfae732c2ebb17ba23/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.321204 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a5752cb8ff415f83a87bb09acd45b5, user_id=cea56b2f91a347bfae732c2ebb17ba23, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:15.324011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:15.337001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1415/2788] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:15 2022] PUT /identity/v3/projects/e2a5752cb8ff415f83a87bb09acd45b5/users/cea56b2f91a347bfae732c2ebb17ba23/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:15.349758 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.350024 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.350320 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.380617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] MFA Rules not processed for user `cea56b2f91a347bfae732c2ebb17ba23`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:15.381814 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:15.456333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1374/2789] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:15.470077 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:15.472611 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:15.540519 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06deb4-bd71-4d44-8975-dd1b035eafc8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:15.545505 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:15.546199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.546471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.546721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.608433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:15.609901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:15.619091 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1416/2790] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:20.925774 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:20.927379 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:20.940972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d348e58-c6fb-4510-ac7c-29354bce41fa None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:20.945433 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29f72-165d-4989-a1d2-a2da1252e1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:20.946170 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29f72-165d-4989-a1d2-a2da1252e1ec service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:20.946324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29f72-165d-4989-a1d2-a2da1252e1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:20.946628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29f72-165d-4989-a1d2-a2da1252e1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:20.958017 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d29f72-165d-4989-a1d2-a2da1252e1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:20.959595 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d29f72-165d-4989-a1d2-a2da1252e1ec service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:20.972386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1375/2791] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:25.948186 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:26.018158 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ae75-dd58-4047-9ca0-f79efc3d0be9 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:26.024299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:26.025454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:26.025941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:26.026220 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] PATH_INFO: `/v3/users/778b6c3ebd9a4555ad62dd87877464ef` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:26.027657 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778b6c3ebd9a4555ad62dd87877464ef)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:26.030747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:26.080876 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778b6c3ebd9a4555ad62dd87877464ef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.092754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778b6c3ebd9a4555ad62dd87877464ef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.105699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778b6c3ebd9a4555ad62dd87877464ef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.113532 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778b6c3ebd9a4555ad62dd87877464ef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.114352 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778b6c3ebd9a4555ad62dd87877464ef'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.120732 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1417/2792] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:25 2022] DELETE /identity/v3/users/778b6c3ebd9a4555ad62dd87877464ef => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:26.126255 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:26.126729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:26.126843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:26.145666 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:26.146901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:26.216965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1376/2793] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:26.227687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:26.229261 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:26.320736 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165b267-f662-4787-b661-6fbcb5c81a07 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:26.324770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:26.325699 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:26.326647 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:26.326967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:26.336740 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:26.338225 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:26.349108 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1418/2794] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:26.639324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:26.640874 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:26.655445 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380854b9-5c24-4ac5-928e-aa9146b8f49b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:26.660514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:26.661401 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:26.661732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:26.662013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] PATH_INFO: `/v3/projects/207dd8ea4b4742019c3642e57c2d049c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:26.663559 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207dd8ea4b4742019c3642e57c2d049c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:26.665646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:26.717724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207dd8ea4b4742019c3642e57c2d049c', 'request_id': 'req-7971cfae-6ee9-43ad-aca4-13a7bab781f6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.724246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207dd8ea4b4742019c3642e57c2d049c', 'request_id': 'req-7971cfae-6ee9-43ad-aca4-13a7bab781f6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.733586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207dd8ea4b4742019c3642e57c2d049c', 'request_id': 'req-7971cfae-6ee9-43ad-aca4-13a7bab781f6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.745009 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] The token cache is being invalidate because project 207dd8ea4b4742019c3642e57c2d049c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:26.745227 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.745905 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.747724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1377/2795] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:26 2022] DELETE /identity/v3/projects/207dd8ea4b4742019c3642e57c2d049c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:26.752894 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:26.762324 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff612b8-f154-4935-8957-a98dd302c3a3 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:26.822985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:26.823905 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:26.824207 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:26.824481 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] PATH_INFO: `/v3/users/cea56b2f91a347bfae732c2ebb17ba23` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:26.825780 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea56b2f91a347bfae732c2ebb17ba23)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:26.827711 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:26.877424 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea56b2f91a347bfae732c2ebb17ba23'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.889529 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea56b2f91a347bfae732c2ebb17ba23'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.907991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea56b2f91a347bfae732c2ebb17ba23'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.915704 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea56b2f91a347bfae732c2ebb17ba23'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.916564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ef3ed247-ec76-4780-b960-1a00de76ab33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea56b2f91a347bfae732c2ebb17ba23'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:26.923347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1419/2796] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:26 2022] DELETE /identity/v3/users/cea56b2f91a347bfae732c2ebb17ba23 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:27.202312 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:27.203835 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:27.218919 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971cfae-6ee9-43ad-aca4-13a7bab781f6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:27.280643 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:27.281432 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.281713 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.281993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] PATH_INFO: `/v3/projects/e2a5752cb8ff415f83a87bb09acd45b5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.283257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a5752cb8ff415f83a87bb09acd45b5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:27.285654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:27.337431 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a5752cb8ff415f83a87bb09acd45b5', 'request_id': 'req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:27.345010 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a5752cb8ff415f83a87bb09acd45b5', 'request_id': 'req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:27.357705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a5752cb8ff415f83a87bb09acd45b5', 'request_id': 'req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:27.368500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] The token cache is being invalidate because project e2a5752cb8ff415f83a87bb09acd45b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:27.368788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:27.369472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14fc7a6b-68ce-48e3-a8ef-9c5eb9574cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:27.371110 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1378/2797] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:27 2022] DELETE /identity/v3/projects/e2a5752cb8ff415f83a87bb09acd45b5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:27.377436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1041b-7b7e-446e-bc5f-0f92b961f9b6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.377946 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1041b-7b7e-446e-bc5f-0f92b961f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.378053 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1041b-7b7e-446e-bc5f-0f92b961f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.397039 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5ac1041b-7b7e-446e-bc5f-0f92b961f9b6 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:27.398255 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5ac1041b-7b7e-446e-bc5f-0f92b961f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:27.460852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1420/2798] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:27.470338 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7abfb-7cf7-497f-9f23-fb8a78904bae None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.471246 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7abfb-7cf7-497f-9f23-fb8a78904bae None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.471817 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7abfb-7cf7-497f-9f23-fb8a78904bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.490415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ffa7abfb-7cf7-497f-9f23-fb8a78904bae None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:27.491737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ffa7abfb-7cf7-497f-9f23-fb8a78904bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:27.500220 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1379/2799] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:27.504805 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1041b-7b7e-446e-bc5f-0f92b961f9b6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:27.516130 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1041b-7b7e-446e-bc5f-0f92b961f9b6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:27.520906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:27.521571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.521853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.522154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.522889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:27.523198 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:27.524885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:27.537082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1421/2800] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:27.541654 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7abfb-7cf7-497f-9f23-fb8a78904bae None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:27.552269 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7abfb-7cf7-497f-9f23-fb8a78904bae None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:27.557364 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:27.558163 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.558324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.558601 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.559314 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:27.562980 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:27.594812 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1380/2801] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:27 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:27.598274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:27.608462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ec6c8-6c16-4f76-86f3-93f081d2c10a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:27.670754 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:27.671440 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.671715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.672026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.672801 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:27.674679 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:27.700083 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1422/2802] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:27 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:27.704843 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:27.716097 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776997c-2405-4d00-a6c5-e45e91c347a1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:27.722450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:27.723123 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.723406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.723680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.724457 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:27.726086 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:27.737975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1381/2803] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:27.742439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:27.753138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7696-a3c8-4e7e-ba17-223eda20ebfa admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:27.758569 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29567bf-0458-47f4-906c-56f294f96a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:27.759266 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29567bf-0458-47f4-906c-56f294f96a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.759548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29567bf-0458-47f4-906c-56f294f96a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.759825 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29567bf-0458-47f4-906c-56f294f96a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.760608 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29567bf-0458-47f4-906c-56f294f96a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:27.762223 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29567bf-0458-47f4-906c-56f294f96a3a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:27.772533 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1423/2804] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:27.776865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:27.787777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79c281-0fcc-4b9d-955c-179b76d099bc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:27.793079 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:27.793965 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.794238 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.794668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] PATH_INFO: `/v3/projects/ac4eda5187564722a560d7e03412e9e5/users/150eae8c579b4128ae58464bc243d757/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.810416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4eda5187564722a560d7e03412e9e5, user_id=150eae8c579b4128ae58464bc243d757, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:27.813209 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:27.828908 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1382/2805] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:27 2022] PUT /identity/v3/projects/ac4eda5187564722a560d7e03412e9e5/users/150eae8c579b4128ae58464bc243d757/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:27.898029 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6dcb-72b9-4c72-a3b2-a2f75a36b4c7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:27.898623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6dcb-72b9-4c72-a3b2-a2f75a36b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:27.898948 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6dcb-72b9-4c72-a3b2-a2f75a36b4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:27.928332 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-70ef6dcb-72b9-4c72-a3b2-a2f75a36b4c7 None None] MFA Rules not processed for user `150eae8c579b4128ae58464bc243d757`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:27.929553 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-70ef6dcb-72b9-4c72-a3b2-a2f75a36b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:27.995021 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1424/2806] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:28.013546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:28.015690 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:28.076815 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea32e8-f721-47e7-b288-a2da14c97783 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:28.080837 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6327466-bee2-442c-b50b-46a5d9c1fdb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:28.081495 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6327466-bee2-442c-b50b-46a5d9c1fdb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:28.081779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6327466-bee2-442c-b50b-46a5d9c1fdb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:28.082085 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6327466-bee2-442c-b50b-46a5d9c1fdb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:28.090779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6327466-bee2-442c-b50b-46a5d9c1fdb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:28.092727 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6327466-bee2-442c-b50b-46a5d9c1fdb3 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:28.102862 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1383/2807] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:43.445564 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef6dcb-72b9-4c72-a3b2-a2f75a36b4c7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:43.514076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef6dcb-72b9-4c72-a3b2-a2f75a36b4c7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:43.519313 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:43.520492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.520796 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.521068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] PATH_INFO: `/v3/users/150eae8c579b4128ae58464bc243d757` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.522299 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=150eae8c579b4128ae58464bc243d757)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:43.524274 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.577020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150eae8c579b4128ae58464bc243d757'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:43.587497 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150eae8c579b4128ae58464bc243d757'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:43.605174 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150eae8c579b4128ae58464bc243d757'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:43.615166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150eae8c579b4128ae58464bc243d757'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:43.615844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150eae8c579b4128ae58464bc243d757'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:43.623152 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1425/2808] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:43 2022] DELETE /identity/v3/users/150eae8c579b4128ae58464bc243d757 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:43.628034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.628528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.628645 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.656776 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:43.658022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:43.729922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1384/2809] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:43.742350 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:43.744790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:43.820797 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb4562-1754-4210-b4f4-fb094849cb2c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:43.825414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e382b-8cc5-4a59-a036-1dcd9fbb002f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:43.826072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e382b-8cc5-4a59-a036-1dcd9fbb002f service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.826355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e382b-8cc5-4a59-a036-1dcd9fbb002f service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.826632 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e382b-8cc5-4a59-a036-1dcd9fbb002f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.836857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e382b-8cc5-4a59-a036-1dcd9fbb002f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:43.838308 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e382b-8cc5-4a59-a036-1dcd9fbb002f service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.848804 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1426/2810] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:44.141346 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.143005 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:44.159137 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ef846-f8a6-4d43-bab1-2122deb84685 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.164807 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.165865 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.166147 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.166365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] PATH_INFO: `/v3/projects/ac4eda5187564722a560d7e03412e9e5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.167626 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4eda5187564722a560d7e03412e9e5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.169746 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.219199 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4eda5187564722a560d7e03412e9e5', 'request_id': 'req-0220436d-4972-4be9-86ef-f27aa9845956'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:44.225661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4eda5187564722a560d7e03412e9e5', 'request_id': 'req-0220436d-4972-4be9-86ef-f27aa9845956'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:44.234396 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4eda5187564722a560d7e03412e9e5', 'request_id': 'req-0220436d-4972-4be9-86ef-f27aa9845956'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:44.244884 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] The token cache is being invalidate because project ac4eda5187564722a560d7e03412e9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:44.245164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:44.245821 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0220436d-4972-4be9-86ef-f27aa9845956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:44.247404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1385/2811] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:44 2022] DELETE /identity/v3/projects/ac4eda5187564722a560d7e03412e9e5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:44.252748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281f0e1-d6d4-486a-895e-179e2e4203d4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.253037 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281f0e1-d6d4-486a-895e-179e2e4203d4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.253315 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281f0e1-d6d4-486a-895e-179e2e4203d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.271576 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4281f0e1-d6d4-486a-895e-179e2e4203d4 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:44.272802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4281f0e1-d6d4-486a-895e-179e2e4203d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:44.331910 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1427/2812] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:44.340066 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9476b0-2a11-48eb-ad94-ad0ea9e7e20b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.340347 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9476b0-2a11-48eb-ad94-ad0ea9e7e20b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.340617 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9476b0-2a11-48eb-ad94-ad0ea9e7e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.360547 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7b9476b0-2a11-48eb-ad94-ad0ea9e7e20b None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:44.361760 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7b9476b0-2a11-48eb-ad94-ad0ea9e7e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:44.370796 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1386/2813] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:44.375182 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281f0e1-d6d4-486a-895e-179e2e4203d4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.385411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281f0e1-d6d4-486a-895e-179e2e4203d4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.390685 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.391339 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.391718 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.392023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.392765 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:44.393071 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.394688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.407502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1428/2814] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:44.412931 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9476b0-2a11-48eb-ad94-ad0ea9e7e20b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.423031 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9476b0-2a11-48eb-ad94-ad0ea9e7e20b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.430022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.430695 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.430975 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.431245 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.432330 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.435276 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.466477 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1387/2815] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:44 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:44.472233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.484025 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc348-56cf-4564-bfc8-d518a032560f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.553514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.554187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.554468 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.554737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.555414 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.557422 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.580328 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1429/2816] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:44 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:44.585046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.595969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce551f7-8d67-4d05-8962-4808c2a3b7c3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.602012 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.602678 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.602956 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.603231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.603999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.605663 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.616316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1388/2817] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:44.622173 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.635446 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01199c3c-7c4d-4176-92de-7efe3baae423 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.640525 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06d3c4-ec9e-4ea1-99ae-0b17378a863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.641179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06d3c4-ec9e-4ea1-99ae-0b17378a863f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.641462 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06d3c4-ec9e-4ea1-99ae-0b17378a863f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.641836 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06d3c4-ec9e-4ea1-99ae-0b17378a863f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.642548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06d3c4-ec9e-4ea1-99ae-0b17378a863f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.644201 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06d3c4-ec9e-4ea1-99ae-0b17378a863f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.656086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1430/2818] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:44.660365 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.670983 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01c23b-2680-411a-95ed-7182b11e4332 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.676686 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.677545 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.677827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.678104 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] PATH_INFO: `/v3/projects/ad2d2bbcfc0c42659c9150d3ba5012af/users/c0e98de8d4724199b381482f91a06d74/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.693570 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2d2bbcfc0c42659c9150d3ba5012af, user_id=c0e98de8d4724199b381482f91a06d74, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.696293 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.713278 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1389/2819] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:44 2022] PUT /identity/v3/projects/ad2d2bbcfc0c42659c9150d3ba5012af/users/c0e98de8d4724199b381482f91a06d74/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:44.719811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87da4b2-82c9-422a-90d3-c9c1d3e6170a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.720454 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87da4b2-82c9-422a-90d3-c9c1d3e6170a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.720751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87da4b2-82c9-422a-90d3-c9c1d3e6170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.737733 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a87da4b2-82c9-422a-90d3-c9c1d3e6170a None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:44.738915 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a87da4b2-82c9-422a-90d3-c9c1d3e6170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:44.794779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1431/2820] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:44.805386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.807131 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:44.865732 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fba3a-1209-4add-a060-7d4d2fc938e0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.870117 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.870750 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.871035 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.871307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.881514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.882952 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.892513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1390/2821] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:46.506451 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:46.506992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:46.506992 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:46.526690 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] MFA Rules not processed for user `f713f767dbf14d10b9100ea52d093d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:46.527924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:46.593986 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1432/2822] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:47.179000 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.187682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65d898-1b8f-4f9c-b0e8-debef48da4ad service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.191922 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eab20-563e-4960-ba3f-aa147502c2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.192840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eab20-563e-4960-ba3f-aa147502c2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.193415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eab20-563e-4960-ba3f-aa147502c2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.193691 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eab20-563e-4960-ba3f-aa147502c2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.195509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ca6eab20-563e-4960-ba3f-aa147502c2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.205719 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eab20-563e-4960-ba3f-aa147502c2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.207145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eab20-563e-4960-ba3f-aa147502c2b3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.216500 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1391/2823] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:47.848113 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.850242 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.939167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b91037-5098-4c31-8e22-bf3014a76c1e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.945256 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.945923 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.946210 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.946488 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.949205 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.964970 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.968859 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.980095 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1433/2824] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:49.894875 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2651-4de4-4558-b7ed-008c711e5bf2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.895461 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2651-4de4-4558-b7ed-008c711e5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.895583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2651-4de4-4558-b7ed-008c711e5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.926982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b44a2651-4de4-4558-b7ed-008c711e5bf2 None None] MFA Rules not processed for user `c0e98de8d4724199b381482f91a06d74`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:49.929308 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b44a2651-4de4-4558-b7ed-008c711e5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.036736 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1392/2825] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:50.038235 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.057619 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa799879-2ee7-44c5-b3c9-ebe35e47e67e service placement] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.063683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.064751 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.065216 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.065643 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.066504 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.069779 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.124889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1434/2826] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:50 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:50.125486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2651-4de4-4558-b7ed-008c711e5bf2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.145707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2651-4de4-4558-b7ed-008c711e5bf2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.290420 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.291741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.292122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.292393 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.293449 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.302738 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.334602 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1393/2827] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:50 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:50.336156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.348888 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03763b5-c957-4344-baf0-b9b3e25e557a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.370664 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.371558 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.371847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.372218 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.372972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.374882 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.386794 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1435/2828] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:50.391349 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.404156 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159856-3630-4e61-94cb-fb4f20f30d2e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.412106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.413563 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.414028 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.414490 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] PATH_INFO: `/v3/projects/a822b0d9bfed4553a161ba1f50e3a01b/users/993fa2b816a34574820502f49bd739f6/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.432249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a822b0d9bfed4553a161ba1f50e3a01b, user_id=993fa2b816a34574820502f49bd739f6, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.435416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.454253 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1394/2829] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:50 2022] PUT /identity/v3/projects/a822b0d9bfed4553a161ba1f50e3a01b/users/993fa2b816a34574820502f49bd739f6/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:50.458421 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.468697 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe382-8f9a-4f1d-ab7c-46ec5e509cb9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.527400 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3d496-e84a-4ce5-a0c2-a9d66d38042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.528273 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3d496-e84a-4ce5-a0c2-a9d66d38042f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.528592 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3d496-e84a-4ce5-a0c2-a9d66d38042f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.529078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3d496-e84a-4ce5-a0c2-a9d66d38042f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.529792 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3d496-e84a-4ce5-a0c2-a9d66d38042f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.531426 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3d496-e84a-4ce5-a0c2-a9d66d38042f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.541676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1436/2830] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:50.546038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.557688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16945ea4-b09f-4222-a461-91e550dcca59 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.563781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.564804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.565280 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.565404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] PATH_INFO: `/v3/projects/a822b0d9bfed4553a161ba1f50e3a01b/users/993fa2b816a34574820502f49bd739f6/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.568140 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a822b0d9bfed4553a161ba1f50e3a01b, user_id=993fa2b816a34574820502f49bd739f6, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.570877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.592640 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1395/2831] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:50 2022] PUT /identity/v3/projects/a822b0d9bfed4553a161ba1f50e3a01b/users/993fa2b816a34574820502f49bd739f6/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:55.968364 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef39d7-409f-48d2-9274-f21bb37b3e27 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.968945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef39d7-409f-48d2-9274-f21bb37b3e27 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.968945 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef39d7-409f-48d2-9274-f21bb37b3e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.018750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1fef39d7-409f-48d2-9274-f21bb37b3e27 None None] MFA Rules not processed for user `993fa2b816a34574820502f49bd739f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:56.020907 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1fef39d7-409f-48d2-9274-f21bb37b3e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.095322 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1437/2832] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:56.107656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.109415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.169586 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b326b-b85e-4cc8-9aa8-ea0d4d4b5691 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.173291 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1525affb11454d977ac931c4feb822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.173979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.174263 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.174541 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.232286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.233789 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.243368 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1396/2833] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:56.345055 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.345355 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.345639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.374983 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:56.376546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.441887 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1438/2834] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:56.492730 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.494159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.565642 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2946f-d4db-4d87-9366-a456e25b068a service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.574629 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f366b-5962-4033-876f-d2891abcc66e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.575296 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f366b-5962-4033-876f-d2891abcc66e service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.575578 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f366b-5962-4033-876f-d2891abcc66e service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.575854 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f366b-5962-4033-876f-d2891abcc66e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.586472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f366b-5962-4033-876f-d2891abcc66e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.587783 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f366b-5962-4033-876f-d2891abcc66e service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.598201 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1397/2835] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:06:56.623035 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.624492 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.703154 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dceed3-010f-4f24-bc66-09e9f5138697 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.709835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.710981 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.711269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.711548 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] PATH_INFO: `/v3/users/c16bc2d6c6b243988cef4ef44e9f019b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.712789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16bc2d6c6b243988cef4ef44e9f019b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.715075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.780406 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16bc2d6c6b243988cef4ef44e9f019b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:56.789070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16bc2d6c6b243988cef4ef44e9f019b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:56.807517 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16bc2d6c6b243988cef4ef44e9f019b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:56.816847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16bc2d6c6b243988cef4ef44e9f019b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:56.818543 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16bc2d6c6b243988cef4ef44e9f019b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:56.831442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1439/2836] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:06:56 2022] DELETE /identity/v3/users/c16bc2d6c6b243988cef4ef44e9f019b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:56.833618 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.834252 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.834569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.860513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:56.861984 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.949788 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1398/2837] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:56.959386 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.960743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:57.042605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b136-a99d-468a-990c-21141b044192 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:57.048238 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508c74d-31f6-408f-a95a-cfacdd622ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:57.049179 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c74d-31f6-408f-a95a-cfacdd622ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.049967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c74d-31f6-408f-a95a-cfacdd622ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.050403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c74d-31f6-408f-a95a-cfacdd622ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.061318 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508c74d-31f6-408f-a95a-cfacdd622ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:57.063577 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508c74d-31f6-408f-a95a-cfacdd622ba6 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:57.100935 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1440/2838] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:57.462522 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:57.464058 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:57.487697 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac16c-5b64-46fb-8ded-ec52b9fde3f0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:57.498548 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:57.499845 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.500284 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.500693 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] PATH_INFO: `/v3/projects/5b2f77cfe7474b91b9ac142235c0986b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.502990 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2f77cfe7474b91b9ac142235c0986b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:57.505482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:57.571546 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2f77cfe7474b91b9ac142235c0986b', 'request_id': 'req-f32de863-3f60-4201-93b3-dff2e89d49d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:57.577810 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2f77cfe7474b91b9ac142235c0986b', 'request_id': 'req-f32de863-3f60-4201-93b3-dff2e89d49d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:57.590307 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2f77cfe7474b91b9ac142235c0986b', 'request_id': 'req-f32de863-3f60-4201-93b3-dff2e89d49d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:57.607893 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] The token cache is being invalidate because project 5b2f77cfe7474b91b9ac142235c0986b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:57.608343 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:57.609969 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f32de863-3f60-4201-93b3-dff2e89d49d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:57.611482 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1399/2839] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:06:57 2022] DELETE /identity/v3/projects/5b2f77cfe7474b91b9ac142235c0986b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:57.618878 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31cfa8-1221-4c90-8a30-23aaa8d6e103 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.619457 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31cfa8-1221-4c90-8a30-23aaa8d6e103 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.619967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31cfa8-1221-4c90-8a30-23aaa8d6e103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.642439 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3b31cfa8-1221-4c90-8a30-23aaa8d6e103 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:57.643908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3b31cfa8-1221-4c90-8a30-23aaa8d6e103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:57.733200 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996571e-20f4-444d-99b5-ccb685699852 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.733422 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996571e-20f4-444d-99b5-ccb685699852 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.733827 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996571e-20f4-444d-99b5-ccb685699852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.733984 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1441/2840] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:57.755385 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8996571e-20f4-444d-99b5-ccb685699852 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:57.757060 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8996571e-20f4-444d-99b5-ccb685699852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:57.771046 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1400/2841] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:57.776683 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31cfa8-1221-4c90-8a30-23aaa8d6e103 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:57.786369 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31cfa8-1221-4c90-8a30-23aaa8d6e103 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:57.791433 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:57.791941 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.792410 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.792712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.793458 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:57.793750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:57.795708 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:57.811932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1442/2842] 10.222.0.99 () {58 vars in 1152 bytes} [Fri May 13 15:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:57.815509 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996571e-20f4-444d-99b5-ccb685699852 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:57.828486 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996571e-20f4-444d-99b5-ccb685699852 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:57.834737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:57.835639 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.836441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.836873 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.837761 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:57.839704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:57.886023 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1401/2843] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:06:57 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:57.888082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:57.899344 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a165-7d0d-47b8-bf5d-546cd58d2517 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:57.982688 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:57.983703 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.984020 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.984415 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.985200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:57.987790 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:58.017993 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1443/2844] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:06:57 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:58.024305 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:58.036422 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7fb0-fe5d-4504-b561-9b97919125da admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:58.041416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:58.042211 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:58.042596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:58.042973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:58.044277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:58.045742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:58.062440 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1402/2845] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:58.063695 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:58.075001 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dae64-237d-4b14-b40f-1a3f182d73c3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:58.080598 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613df50-5e9f-4e1a-8bcb-b5f986c07ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:58.081283 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613df50-5e9f-4e1a-8bcb-b5f986c07ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:58.081568 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613df50-5e9f-4e1a-8bcb-b5f986c07ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:58.081847 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613df50-5e9f-4e1a-8bcb-b5f986c07ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:58.082616 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613df50-5e9f-4e1a-8bcb-b5f986c07ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:58.084445 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613df50-5e9f-4e1a-8bcb-b5f986c07ddb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:58.098099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1444/2846] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:58.102214 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:58.114271 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f255b-a307-4078-8c9d-a63e64987638 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:58.127672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:58.129514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:58.129864 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:58.130369 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] PATH_INFO: `/v3/projects/e43258e7d75e41f3b8763db3122c86b3/users/6eb4364f9eb6426581b983a436671b2e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:58.150452 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43258e7d75e41f3b8763db3122c86b3, user_id=6eb4364f9eb6426581b983a436671b2e, role_id=b66b87740a8d4d3d9283fa1b8e45e2f3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:58.153915 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:58.176765 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1403/2847] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:06:58 2022] PUT /identity/v3/projects/e43258e7d75e41f3b8763db3122c86b3/users/6eb4364f9eb6426581b983a436671b2e/roles/b66b87740a8d4d3d9283fa1b8e45e2f3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:58.178436 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:58.178752 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:58.179070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:58.200276 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] MFA Rules not processed for user `3521504b5b0e494782ca07b80f916dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:58.202597 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:58.295432 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1445/2848] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:58.306981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:58.309240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:58.385840 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ffe18-2a5e-478b-8bf6-d7c84e9b7911 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:58.394451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ae78-10a9-453a-b595-e90907696b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:58.395656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ae78-10a9-453a-b595-e90907696b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:58.395987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ae78-10a9-453a-b595-e90907696b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:58.396323 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ae78-10a9-453a-b595-e90907696b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:58.406644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ae78-10a9-453a-b595-e90907696b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:58.408363 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ae78-10a9-453a-b595-e90907696b5e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:58.419780 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1404/2849] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:04.390519 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:04.393265 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:04.443052 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2ec8f-d5a9-4b2d-9386-e3c4c60428f3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:04.443564 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2ec8f-d5a9-4b2d-9386-e3c4c60428f3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:04.443799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2ec8f-d5a9-4b2d-9386-e3c4c60428f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:04.509747 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c4a2ec8f-d5a9-4b2d-9386-e3c4c60428f3 None None] MFA Rules not processed for user `6eb4364f9eb6426581b983a436671b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:04.528257 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4a2ec8f-d5a9-4b2d-9386-e3c4c60428f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:04.546810 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49532aa3-befc-4363-bc3a-f23753504d94 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:04.556663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:04.558442 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:04.558955 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:04.559587 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:04.562166 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:04.586139 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:04.588138 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:04.609760 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1446/2850] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:04.722318 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1405/2851] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:04.728298 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:04.750452 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b651bd-0ebb-4b3e-9e03-36f1ef046eb1 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:04.782389 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:04.783459 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:04.783750 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:04.784059 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:04.784885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:04.787078 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:04.857233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1447/2852] 10.222.0.99 () {60 vars in 1152 bytes} [Fri May 13 15:07:04 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:04.860974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2ec8f-d5a9-4b2d-9386-e3c4c60428f3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:04.881464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2ec8f-d5a9-4b2d-9386-e3c4c60428f3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:05.025181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:05.026558 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:05.031014 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:05.031717 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:05.032704 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:05.035108 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:05.058910 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1406/2853] 10.222.0.99 () {60 vars in 1143 bytes} [Fri May 13 15:07:04 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:05.062961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:05.079240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f02396-d108-464a-8ded-31e604eecf69 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:05.085823 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:05.086596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:05.086947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:05.087530 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:05.088164 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:05.089918 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:05.102199 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1448/2854] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:05.106389 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:05.117371 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa564-ec4a-4802-b2a1-dea4dac1c9a6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:05.128668 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:05.131419 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:05.131962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:05.132247 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] PATH_INFO: `/v3/projects/6e6150efe83a498e9b5fcac886f24bcf/users/24384cf141a64690a4e4c88774621f6a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:05.165013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6150efe83a498e9b5fcac886f24bcf, user_id=24384cf141a64690a4e4c88774621f6a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:05.168352 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:05.198763 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1407/2855] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:07:05 2022] PUT /identity/v3/projects/6e6150efe83a498e9b5fcac886f24bcf/users/24384cf141a64690a4e4c88774621f6a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:05.202496 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:05.223666 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad75f8-84e7-48a1-85fd-24c64adc1b3d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:05.324070 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:05.325065 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:05.325506 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:05.325939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:05.326831 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:05.329008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:05.344943 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1449/2856] 10.222.0.99 () {58 vars in 1121 bytes} [Fri May 13 15:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:05.350270 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:05.361973 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a85ce-9b2a-4892-b106-2c2c67374505 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:05.367953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9be10-5d21-46d7-9355-2b8457f9a36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:05.368955 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9be10-5d21-46d7-9355-2b8457f9a36f admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:05.369231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9be10-5d21-46d7-9355-2b8457f9a36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:05.369510 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9be10-5d21-46d7-9355-2b8457f9a36f admin admin] PATH_INFO: `/v3/projects/6e6150efe83a498e9b5fcac886f24bcf/users/24384cf141a64690a4e4c88774621f6a/roles/310ee24d9efc471eb557c89ee02ee46e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:05.371901 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9be10-5d21-46d7-9355-2b8457f9a36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6150efe83a498e9b5fcac886f24bcf, user_id=24384cf141a64690a4e4c88774621f6a, role_id=310ee24d9efc471eb557c89ee02ee46e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:05.374777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9be10-5d21-46d7-9355-2b8457f9a36f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:05.391684 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1408/2857] 10.222.0.99 () {60 vars in 1482 bytes} [Fri May 13 15:07:05 2022] PUT /identity/v3/projects/6e6150efe83a498e9b5fcac886f24bcf/users/24384cf141a64690a4e4c88774621f6a/roles/310ee24d9efc471eb557c89ee02ee46e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:08.128541 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:08.131484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:08.231692 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658396ca-144c-4f68-95f8-a107fcf705b6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:08.297511 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:08.298190 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:08.298471 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:08.299200 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:08.301638 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:08.390759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:08.392531 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:08.408229 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1450/2858] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:10.228145 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:10.228688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:10.228688 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:10.270133 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] MFA Rules not processed for user `c0e98de8d4724199b381482f91a06d74`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:10.271435 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:10.408333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1409/2859] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:07:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:11.076092 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:11.096434 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67aa9c-5def-446e-b7e1-58c24b43f351 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:11.107437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:11.108343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:11.108629 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:11.108908 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:11.111428 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:11.144126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:11.146051 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:11.166297 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1451/2860] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:11.267013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:11.269013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:11.542162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8c5e-e32d-4309-9820-da2c2e5fc67e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:11.553074 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569a932-7638-4436-9fba-91f5ed98ebf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:11.553896 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569a932-7638-4436-9fba-91f5ed98ebf9 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:11.554277 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569a932-7638-4436-9fba-91f5ed98ebf9 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:11.554916 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569a932-7638-4436-9fba-91f5ed98ebf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:11.556953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f569a932-7638-4436-9fba-91f5ed98ebf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:11.590658 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569a932-7638-4436-9fba-91f5ed98ebf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:11.592724 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569a932-7638-4436-9fba-91f5ed98ebf9 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:11.613274 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1410/2861] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:11.660512 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:11.662060 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:11.871178 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf81f4-3a88-42b1-b861-0e46d3fab2ca service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:11.891906 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:11.892670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:11.892957 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:11.893240 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:11.901844 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:11.941829 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:11.943618 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:11.978203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1452/2862] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:13.263962 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625562b-bc1f-4b15-a2d3-afbc02c7bbd6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.264628 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625562b-bc1f-4b15-a2d3-afbc02c7bbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.264748 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625562b-bc1f-4b15-a2d3-afbc02c7bbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.302784 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8625562b-bc1f-4b15-a2d3-afbc02c7bbd6 None None] MFA Rules not processed for user `24384cf141a64690a4e4c88774621f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:13.304157 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8625562b-bc1f-4b15-a2d3-afbc02c7bbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:13.389329 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1411/2863] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:13.402667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.414513 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fae7d2-acf2-414b-a231-eb4912c756ce service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.421883 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1adf2b-7343-4a5c-b26b-3f644e955e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.422743 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1adf2b-7343-4a5c-b26b-3f644e955e4c service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.423280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1adf2b-7343-4a5c-b26b-3f644e955e4c service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.423832 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1adf2b-7343-4a5c-b26b-3f644e955e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.483046 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1adf2b-7343-4a5c-b26b-3f644e955e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.484676 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1adf2b-7343-4a5c-b26b-3f644e955e4c service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.493798 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1453/2864] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:14.666886 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:14.667462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:14.667462 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:14.687603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] MFA Rules not processed for user `6eb4364f9eb6426581b983a436671b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:14.688890 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:14.696718 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1412/2865] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:17.548374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e6c36-d8a7-43fd-99e2-27dce2a27470 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.548962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e6c36-d8a7-43fd-99e2-27dce2a27470 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.548962 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e6c36-d8a7-43fd-99e2-27dce2a27470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.610411 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6d2e6c36-d8a7-43fd-99e2-27dce2a27470 None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:17.612270 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6d2e6c36-d8a7-43fd-99e2-27dce2a27470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.714717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1454/2866] 10.222.0.99 () {58 vars in 1009 bytes} [Fri May 13 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:17.730472 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.732027 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.839652 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60d226-433a-42bc-8466-57c84090ce7a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.845842 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.846725 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.847186 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.847806 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.863528 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.865599 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.874682 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1413/2867] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:07:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:07:54.045602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e6c36-d8a7-43fd-99e2-27dce2a27470 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:54.056873 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e6c36-d8a7-43fd-99e2-27dce2a27470 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:54.061417 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:54.062062 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.062347 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.062603 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.064889 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:54.132924 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:54.134605 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:54.144018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1455/2868] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:57.599315 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:57.609451 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f35f-50dd-4e8a-b792-9b42bcd875b5 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:57.613989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:57.614673 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:57.614953 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:57.615225 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:57.625646 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:57.627106 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:57.637416 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1414/2869] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:09:09.936861 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:09.946346 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54a165-6714-4f81-97d8-efbe64f40f69 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:09.950835 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5830995-c09a-456e-a031-a60a94908915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:09.951482 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5830995-c09a-456e-a031-a60a94908915 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:09.952430 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5830995-c09a-456e-a031-a60a94908915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:09.952712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5830995-c09a-456e-a031-a60a94908915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:09.954930 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c5830995-c09a-456e-a031-a60a94908915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:09.984419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5830995-c09a-456e-a031-a60a94908915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:09.985865 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5830995-c09a-456e-a031-a60a94908915 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:10.007437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1456/2870] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:09:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:09:38.847770 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:38.860231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d1c26-41f8-4649-b747-87adb39b61d1 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:38.866298 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:38.866954 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:38.867240 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:38.867519 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:38.869737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:38.887505 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:38.889877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:38.908287 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1415/2871] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:09:43.506326 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb3d94-6db2-4f20-b686-267f0600a087 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:43.506858 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb3d94-6db2-4f20-b686-267f0600a087 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:43.506961 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb3d94-6db2-4f20-b686-267f0600a087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:43.524818 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-94eb3d94-6db2-4f20-b686-267f0600a087 None None] MFA Rules not processed for user `f713f767dbf14d10b9100ea52d093d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:43.526018 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-94eb3d94-6db2-4f20-b686-267f0600a087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:43.584230 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1457/2872] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:09:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:10:04.002769 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:04.014920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee09b1-6f95-4f0c-b423-89c204f7ee66 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:04.020982 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e2089-6070-494e-80e2-1b867bd83f0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:04.021610 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e2089-6070-494e-80e2-1b867bd83f0b service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:04.021894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e2089-6070-494e-80e2-1b867bd83f0b service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:04.022217 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e2089-6070-494e-80e2-1b867bd83f0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:04.024386 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-632e2089-6070-494e-80e2-1b867bd83f0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:04.036781 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e2089-6070-494e-80e2-1b867bd83f0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:04.039122 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e2089-6070-494e-80e2-1b867bd83f0b service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:04.050092 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1416/2873] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:10:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:10:04.142413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb3d94-6db2-4f20-b686-267f0600a087 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:04.154294 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb3d94-6db2-4f20-b686-267f0600a087 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:04.158996 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:04.159650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:04.159959 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:04.160236 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:04.162450 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:04.173043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:04.174540 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:04.183143 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1458/2874] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:10:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:10:24.207709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:24.208360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:24.208360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:24.229940 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] MFA Rules not processed for user `37073a0901464b2393b6b8fa9d71b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:10:24.231514 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:24.241084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1417/2875] 10.222.0.99 () {58 vars in 967 bytes} [Fri May 13 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:10:24.288437 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:24.302770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797c468-7e90-4be8-84fa-01c2497e7203 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:24.310808 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f71bb499b4e4f5cbb0caeee2d30387a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:24.311476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:24.311811 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:24.312374 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:24.325076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:24.326659 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:24.334879 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1459/2876] 10.222.0.99 () {60 vars in 1384 bytes} [Fri May 13 15:10:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:10:31.684231 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:31.686103 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:31.764665 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1f77-be7e-43cd-b781-0fcbcd303c9e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:31.769164 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:31.770038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:31.770322 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:31.770600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] PATH_INFO: `/v3/users/c0e98de8d4724199b381482f91a06d74` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:31.771888 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e98de8d4724199b381482f91a06d74)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:31.773838 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:31.822465 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e98de8d4724199b381482f91a06d74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:31.829594 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e98de8d4724199b381482f91a06d74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:31.830360 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e98de8d4724199b381482f91a06d74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:31.842716 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e98de8d4724199b381482f91a06d74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:31.843404 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e98de8d4724199b381482f91a06d74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:31.857877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1418/2877] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:10:31 2022] DELETE /identity/v3/users/c0e98de8d4724199b381482f91a06d74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:10:32.036484 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:32.048932 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251213ec-3337-45e1-952b-275aba56d617 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:32.110748 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:32.111668 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:32.111979 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:32.112292 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] PATH_INFO: `/v3/projects/ad2d2bbcfc0c42659c9150d3ba5012af` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:32.113501 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2d2bbcfc0c42659c9150d3ba5012af)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:32.115356 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:32.166144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:32.167994 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:32.177110 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'request_id': 'req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.184757 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'request_id': 'req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.194284 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'request_id': 'req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.207795 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] The token cache is being invalidate because project ad2d2bbcfc0c42659c9150d3ba5012af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:10:32.208109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.208776 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.211076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1460/2878] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:10:32 2022] DELETE /identity/v3/projects/ad2d2bbcfc0c42659c9150d3ba5012af => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:10:32.215715 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:32.218202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:32.231177 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5c96d-ce21-4ae1-8179-4e70ca53eb46 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:32.282555 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:32.283216 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:32.283501 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:32.283779 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:32.285822 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:32.286191 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2ce2-9b82-402d-a32b-01ce7c20dd56 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:32.291572 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:32.293919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:32.293919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:32.293919 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] PATH_INFO: `/v3/users/993fa2b816a34574820502f49bd739f6` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:32.295343 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=993fa2b816a34574820502f49bd739f6)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:32.296022 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:32.297742 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:32.300203 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:32.307560 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1419/2879] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:10:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:10:32.370639 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993fa2b816a34574820502f49bd739f6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.378985 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993fa2b816a34574820502f49bd739f6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.390972 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993fa2b816a34574820502f49bd739f6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.398010 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993fa2b816a34574820502f49bd739f6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.398809 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993fa2b816a34574820502f49bd739f6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.406486 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1461/2880] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:10:32 2022] DELETE /identity/v3/users/993fa2b816a34574820502f49bd739f6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:10:32.585042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:32.597138 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea689e6-d45a-4e09-aeac-18f1849b4028 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:32.664636 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:32.665543 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:32.665825 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:32.666101 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] PATH_INFO: `/v3/projects/a822b0d9bfed4553a161ba1f50e3a01b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:32.667377 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a822b0d9bfed4553a161ba1f50e3a01b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:32.669468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:32.721219 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a822b0d9bfed4553a161ba1f50e3a01b', 'request_id': 'req-42891d66-dbb3-4af6-8230-72887d19d011'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.727635 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a822b0d9bfed4553a161ba1f50e3a01b', 'request_id': 'req-42891d66-dbb3-4af6-8230-72887d19d011'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.738073 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a822b0d9bfed4553a161ba1f50e3a01b', 'request_id': 'req-42891d66-dbb3-4af6-8230-72887d19d011'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.749249 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] The token cache is being invalidate because project a822b0d9bfed4553a161ba1f50e3a01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:10:32.749554 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.750181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:10:32.751729 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1420/2881] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:10:32 2022] DELETE /identity/v3/projects/a822b0d9bfed4553a161ba1f50e3a01b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:10:33.420082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:33.422269 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:33.482891 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5baa96-6e83-4cc2-9a9d-ff8630395459 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:33.537011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:33.537667 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:33.537947 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:33.538215 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:33.540441 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:33.612149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:33.613498 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:33.624635 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1462/2882] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:06.534619 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:06.536222 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:06.633466 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42891d66-dbb3-4af6-8230-72887d19d011 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:06.638516 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f9c9d-629a-4382-8f02-605081b23b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e156813f50bf4f1193ecb279fad65b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:06.639179 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9c9d-629a-4382-8f02-605081b23b43 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:06.639464 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9c9d-629a-4382-8f02-605081b23b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:06.639737 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9c9d-629a-4382-8f02-605081b23b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:06.641929 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9b0f9c9d-629a-4382-8f02-605081b23b43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:06.702151 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f9c9d-629a-4382-8f02-605081b23b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:06.703623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f9c9d-629a-4382-8f02-605081b23b43 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:06.713205 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1421/2883] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:15.337663 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:15.339305 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:15.416623 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ab6bc-36f5-4197-a58e-fdfae39feadd service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:15.422476 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:15.423126 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:15.423419 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:15.423693 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:15.425770 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:15.438004 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:15.439606 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:15.450998 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1463/2884] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:17.787261 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:17.787800 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:17.787974 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:17.805801 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] MFA Rules not processed for user `f713f767dbf14d10b9100ea52d093d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:12:17.807013 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:17.815709 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1422/2885] 10.222.0.99 () {58 vars in 957 bytes} [Fri May 13 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:12:18.151816 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:18.153408 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:18.165705 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897d63-2f5d-468d-9150-4b30c1917250 service placement] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:18.170090 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:18.170729 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:18.171017 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:18.171291 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:18.173175 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:18.182448 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:18.183901 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:18.191721 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1464/2886] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:19.961972 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:19.963671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:19.979907 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fccbe8-91b1-47dc-8811-f3726d0a769b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:19.986042 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:19.986680 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:19.986960 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:19.987237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:19.989084 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:20.002569 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:20.004571 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:20.015259 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1423/2887] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:26.642011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:26.643717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:26.654546 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f7fc-3df6-47c0-94a9-9ef92ef38138 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:26.658789 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:26.659435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:26.659714 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:26.660011 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:26.661885 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:26.725493 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:26.727233 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:26.736267 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1465/2888] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:32.145707 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:32.155382 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf30e9-428d-4c2c-a313-eb7c91718d99 service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:32.159034 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:32.159671 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:32.159993 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:32.160264 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:32.162026 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:32.226828 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:32.228406 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:32.238135 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1424/2889] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:35.916075 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:35.918202 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:35.934949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488530da-6050-420f-ad8c-be046d7d4a9d service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:35.940403 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:35.941068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:35.941353 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:35.941631 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:35.943491 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:35.958717 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:35.960354 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:35.972686 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1466/2890] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:39.172144 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:39.182159 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933d28b-f299-42ab-91d5-9841fe9b1b90 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:39.185999 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:39.187656 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:39.188158 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:39.188437 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:39.190316 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:39.275623 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:39.277441 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:39.288206 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1425/2891] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:39.304852 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:39.306782 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:39.327122 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36cb6-0250-45f1-8cd3-7995a01d8ae7 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:39.332275 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:39.333307 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:39.333596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:39.333869 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] PATH_INFO: `/v3/users/6eb4364f9eb6426581b983a436671b2e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:39.335086 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb4364f9eb6426581b983a436671b2e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:39.337557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:39.388418 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb4364f9eb6426581b983a436671b2e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.396940 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb4364f9eb6426581b983a436671b2e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.408673 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb4364f9eb6426581b983a436671b2e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.415502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb4364f9eb6426581b983a436671b2e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.416187 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb4364f9eb6426581b983a436671b2e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.422023 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1467/2892] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:12:39 2022] DELETE /identity/v3/users/6eb4364f9eb6426581b983a436671b2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:12:39.754764 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:39.766468 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eefd4f-0c7a-4d3b-af3a-2f95cd5bc5cb service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:39.830057 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:39.831188 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:39.831582 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:39.831957 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] PATH_INFO: `/v3/projects/e43258e7d75e41f3b8763db3122c86b3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:39.833342 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43258e7d75e41f3b8763db3122c86b3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:39.835856 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:39.888591 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43258e7d75e41f3b8763db3122c86b3', 'request_id': 'req-5e275c6d-a7eb-4023-b44c-f65beb70d68d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.895176 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43258e7d75e41f3b8763db3122c86b3', 'request_id': 'req-5e275c6d-a7eb-4023-b44c-f65beb70d68d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.904244 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43258e7d75e41f3b8763db3122c86b3', 'request_id': 'req-5e275c6d-a7eb-4023-b44c-f65beb70d68d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.916766 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] The token cache is being invalidate because project e43258e7d75e41f3b8763db3122c86b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:12:39.917089 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.917808 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:39.919475 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1426/2893] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:12:39 2022] DELETE /identity/v3/projects/e43258e7d75e41f3b8763db3122c86b3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:12:39.923615 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:39.925072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:39.939280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a675fb4-85aa-4162-a4cd-cebd1231a477 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:39.995802 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:39.996759 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:39.997043 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:39.997323 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] PATH_INFO: `/v3/users/24384cf141a64690a4e4c88774621f6a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:39.998557 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=24384cf141a64690a4e4c88774621f6a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:40.000547 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:40.048949 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24384cf141a64690a4e4c88774621f6a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.057655 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24384cf141a64690a4e4c88774621f6a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.071156 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24384cf141a64690a4e4c88774621f6a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.078747 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24384cf141a64690a4e4c88774621f6a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.079514 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24384cf141a64690a4e4c88774621f6a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.085737 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1468/2894] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:12:39 2022] DELETE /identity/v3/users/24384cf141a64690a4e4c88774621f6a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:12:40.272047 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:40.273603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:40.288883 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275c6d-a7eb-4023-b44c-f65beb70d68d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:40.350705 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:40.351596 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:40.351848 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:40.352185 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] PATH_INFO: `/v3/projects/6e6150efe83a498e9b5fcac886f24bcf` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:40.353450 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6150efe83a498e9b5fcac886f24bcf)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:40.355400 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:40.404948 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6150efe83a498e9b5fcac886f24bcf', 'request_id': 'req-94c16168-f46b-4442-9805-127cb574c19c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.411324 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6150efe83a498e9b5fcac886f24bcf', 'request_id': 'req-94c16168-f46b-4442-9805-127cb574c19c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.420741 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6150efe83a498e9b5fcac886f24bcf', 'request_id': 'req-94c16168-f46b-4442-9805-127cb574c19c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.432237 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] The token cache is being invalidate because project 6e6150efe83a498e9b5fcac886f24bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:12:40.432527 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.433181 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:12:40.434754 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1427/2895] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:12:40 2022] DELETE /identity/v3/projects/6e6150efe83a498e9b5fcac886f24bcf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:12:41.402125 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:41.403641 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:41.480974 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11160a-da99-4df0-a5b4-b698fb96b0dd admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:41.544853 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38f74d30b6da44cb8f60e87f44da4ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:41.545527 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:41.545812 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:41.546109 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:41.548149 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:41.561349 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:41.562938 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:41.574003 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1469/2896] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:12:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:14:31.318861 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:31.320424 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:31.383900 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c16168-f46b-4442-9805-127cb574c19c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:31.387894 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:31.388583 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:31.388850 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:31.389130 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:31.391043 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:31.406751 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:31.408286 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:31.421002 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1428/2897] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:14:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:14:39.378939 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:39.389701 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f30d-f91e-42ab-b0df-6bab17a2d109 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:39.394254 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:39.394951 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:39.395253 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:39.395579 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:39.397942 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:39.414073 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:39.415602 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:39.428082 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1470/2898] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:14:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:14:43.618333 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:43.619799 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:43.630989 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c405-a79f-4353-9d9d-642744b7b53b service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:43.634785 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e8247739e24fcd9b067f1aa1cb9b79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:43.635439 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:43.635777 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:43.636223 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:43.638038 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:43.701496 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:43.702991 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:43.713759 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1429/2899] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:14:50.701653 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:50.703111 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:50.718991 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d749-d631-41ee-9258-243970b1e40d service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:50.724099 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:50.725038 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:50.725302 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:50.725586 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] PATH_INFO: `/v3/users/f713f767dbf14d10b9100ea52d093d6b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:50.726806 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f713f767dbf14d10b9100ea52d093d6b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:50.728857 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:50.779571 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f713f767dbf14d10b9100ea52d093d6b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:50.788312 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f713f767dbf14d10b9100ea52d093d6b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:50.803502 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f713f767dbf14d10b9100ea52d093d6b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:50.811076 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f713f767dbf14d10b9100ea52d093d6b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:50.811967 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f713f767dbf14d10b9100ea52d093d6b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:50.818712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1471/2900] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:14:50 2022] DELETE /identity/v3/users/f713f767dbf14d10b9100ea52d093d6b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:14:51.002469 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:51.015672 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c5f6-7e88-47cd-83bf-00c3ddcba552 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:51.076987 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:51.077877 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:51.078160 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:51.078415 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] PATH_INFO: `/v3/projects/76d2cdfd3aac43e3bb71ae6dda71da82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:51.079615 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d2cdfd3aac43e3bb71ae6dda71da82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:51.081603 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:51.130647 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d2cdfd3aac43e3bb71ae6dda71da82', 'request_id': 'req-5ed286ca-8b0d-496c-924b-476ae48f2f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.136979 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d2cdfd3aac43e3bb71ae6dda71da82', 'request_id': 'req-5ed286ca-8b0d-496c-924b-476ae48f2f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.146162 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d2cdfd3aac43e3bb71ae6dda71da82', 'request_id': 'req-5ed286ca-8b0d-496c-924b-476ae48f2f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.156513 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] The token cache is being invalidate because project 76d2cdfd3aac43e3bb71ae6dda71da82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:14:51.156804 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.157447 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.159474 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1430/2901] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:14:51 2022] DELETE /identity/v3/projects/76d2cdfd3aac43e3bb71ae6dda71da82 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:14:51.163494 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:51.165168 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:51.178670 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac066-4c17-46da-b7c8-d50abdfd00f3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:51.238026 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:51.238892 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:51.239167 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:51.239435 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] PATH_INFO: `/v3/users/abd41b7cc2924182af5c3093824ebc3e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:51.240650 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd41b7cc2924182af5c3093824ebc3e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:51.242567 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:51.299280 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd41b7cc2924182af5c3093824ebc3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.308219 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd41b7cc2924182af5c3093824ebc3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.319559 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd41b7cc2924182af5c3093824ebc3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.326897 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd41b7cc2924182af5c3093824ebc3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.327596 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd41b7cc2924182af5c3093824ebc3e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.333846 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1472/2902] 10.222.0.99 () {58 vars in 1223 bytes} [Fri May 13 15:14:51 2022] DELETE /identity/v3/users/abd41b7cc2924182af5c3093824ebc3e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:14:51.526981 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:51.528644 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:14:51.542661 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed286ca-8b0d-496c-924b-476ae48f2f25 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:51.600616 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3521504b5b0e494782ca07b80f916dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '874372a810af4de2a4ad12d67714243a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:51.601470 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:51.601749 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:51.602019 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] PATH_INFO: `/v3/projects/08ca871baa4544fc8d3bbb3e758a346c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:51.603228 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ca871baa4544fc8d3bbb3e758a346c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:51.605340 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:51.652410 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ca871baa4544fc8d3bbb3e758a346c', 'request_id': 'req-59d13201-e5c2-463f-adc7-9f7d694e5999'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.658600 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ca871baa4544fc8d3bbb3e758a346c', 'request_id': 'req-59d13201-e5c2-463f-adc7-9f7d694e5999'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.666920 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ca871baa4544fc8d3bbb3e758a346c', 'request_id': 'req-59d13201-e5c2-463f-adc7-9f7d694e5999'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.679847 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] The token cache is being invalidate because project 08ca871baa4544fc8d3bbb3e758a346c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:14:51.680178 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.680909 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-59d13201-e5c2-463f-adc7-9f7d694e5999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:14:51.682675 dv-cinder-830901-6-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1431/2903] 10.222.0.99 () {58 vars in 1232 bytes} [Fri May 13 15:14:51 2022] DELETE /identity/v3/projects/08ca871baa4544fc8d3bbb3e758a346c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:17:23.224008 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:23.225712 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:17:23.380251 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f915a-6718-480c-932a-0938df9a53b2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:23.444413 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781c064-09e6-4088-9c64-d30b0ef27f5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b12b26b87d438c8f4eb61c8a93b31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41e4b8a3b6845f0a8e353b947334fe6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:23.445327 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781c064-09e6-4088-9c64-d30b0ef27f5a service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:23.445687 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781c064-09e6-4088-9c64-d30b0ef27f5a service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:23.446068 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781c064-09e6-4088-9c64-d30b0ef27f5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:23.448756 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2781c064-09e6-4088-9c64-d30b0ef27f5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:17:23.460625 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781c064-09e6-4088-9c64-d30b0ef27f5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:23.462296 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781c064-09e6-4088-9c64-d30b0ef27f5a service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:23.473072 dv-cinder-830901-6-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1473/2904] 10.222.0.99 () {60 vars in 1365 bytes} [Fri May 13 15:17:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)